2026-02-13T02:30:55.286 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T02:30:55.306 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T02:30:55.388 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '48009' kernel: client: branch: testing sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded mgr-modules: - snap_schedule sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7166 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 604/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI9u81suSsA6kemfZefLb7Hw4xg9QNchjZgatYU546yfvjNgrKowuUKBRnKt0iFSqRcnSVk1Y2Rd7aWFidf5T3k= trial091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIneiVMUsJke9mhg7eM0ogct0mh8nPDdcU5KVSQ1fyrq7UoEgbACBYkjQ0eRDFV6ti7n1vHxNgSw1WClviLGQTY= trial154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuP5kVlcILLd4VRAp3fAGUD3eXjTZ1K+1FISbTp/OgvskvdCcmZoZxr0Bxyv2e7aVDutQRmFb6OucwGUBZ6lvg= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - "if yaml.os_type == \"rocky\" then\n log.debug(\"not testing on rocky: https://tracker.ceph.com/issues/74907\"\ )\n reject()\nend\n" teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:53:26 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T02:30:55.389 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa; will attempt to use it 2026-02-13T02:30:55.389 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks 2026-02-13T02:30:55.389 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T02:30:55.391 INFO:teuthology.task.internal:Checking packages... 2026-02-13T02:30:55.391 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T02:30:55.391 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T02:30:55.391 INFO:teuthology.packaging:ref: None 2026-02-13T02:30:55.391 INFO:teuthology.packaging:tag: None 2026-02-13T02:30:55.391 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T02:30:55.391 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:30:55.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T02:30:55.514 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T02:30:55.515 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T02:30:55.527 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T02:30:55.527 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T02:30:55.542 INFO:teuthology.task.internal:Saving configuration 2026-02-13T02:30:55.563 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T02:30:55.575 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T02:30:55.649 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial078.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:27:32.793247', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI9u81suSsA6kemfZefLb7Hw4xg9QNchjZgatYU546yfvjNgrKowuUKBRnKt0iFSqRcnSVk1Y2Rd7aWFidf5T3k='} 2026-02-13T02:30:55.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial091.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:27:32.792251', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIneiVMUsJke9mhg7eM0ogct0mh8nPDdcU5KVSQ1fyrq7UoEgbACBYkjQ0eRDFV6ti7n1vHxNgSw1WClviLGQTY='} 2026-02-13T02:30:55.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial154.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:27:32.792903', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuP5kVlcILLd4VRAp3fAGUD3eXjTZ1K+1FISbTp/OgvskvdCcmZoZxr0Bxyv2e7aVDutQRmFb6OucwGUBZ6lvg='} 2026-02-13T02:30:55.759 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T02:30:55.771 INFO:teuthology.task.internal:roles: ubuntu@trial078.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T02:30:55.771 INFO:teuthology.task.internal:roles: ubuntu@trial091.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T02:30:55.771 INFO:teuthology.task.internal:roles: ubuntu@trial154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T02:30:55.771 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T02:30:55.960 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7d02fdfd2a20>, signals=[15]) 2026-02-13T02:30:55.960 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T02:30:55.971 INFO:teuthology.task.internal:Opening connections... 2026-02-13T02:30:55.971 DEBUG:teuthology.task.internal:connecting to ubuntu@trial078.front.sepia.ceph.com 2026-02-13T02:30:55.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:30:56.032 DEBUG:teuthology.task.internal:connecting to ubuntu@trial091.front.sepia.ceph.com 2026-02-13T02:30:56.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:30:56.095 DEBUG:teuthology.task.internal:connecting to ubuntu@trial154.front.sepia.ceph.com 2026-02-13T02:30:56.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:30:56.157 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T02:30:56.170 DEBUG:teuthology.orchestra.run.trial078:> uname -m 2026-02-13T02:30:56.185 INFO:teuthology.orchestra.run.trial078.stdout:x86_64 2026-02-13T02:30:56.185 DEBUG:teuthology.orchestra.run.trial078:> cat /etc/os-release 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:NAME="CentOS Stream" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:VERSION="9" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:ID="centos" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:ID_LIKE="rhel fedora" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:VERSION_ID="9" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:PLATFORM_ID="platform:el9" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:ANSI_COLOR="0;31" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:LOGO="fedora-logo-icon" 2026-02-13T02:30:56.242 INFO:teuthology.orchestra.run.trial078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T02:30:56.243 INFO:teuthology.orchestra.run.trial078.stdout:HOME_URL="https://centos.org/" 2026-02-13T02:30:56.243 INFO:teuthology.orchestra.run.trial078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T02:30:56.243 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T02:30:56.243 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T02:30:56.243 INFO:teuthology.lock.ops:Updating trial078.front.sepia.ceph.com on lock server 2026-02-13T02:30:56.317 DEBUG:teuthology.orchestra.run.trial091:> uname -m 2026-02-13T02:30:56.332 INFO:teuthology.orchestra.run.trial091.stdout:x86_64 2026-02-13T02:30:56.332 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release 2026-02-13T02:30:56.388 INFO:teuthology.orchestra.run.trial091.stdout:NAME="CentOS Stream" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="9" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:ID="centos" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel fedora" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="9" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el9" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;31" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T02:30:56.389 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://centos.org/" 2026-02-13T02:30:56.390 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T02:30:56.390 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T02:30:56.390 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T02:30:56.390 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server 2026-02-13T02:30:56.470 DEBUG:teuthology.orchestra.run.trial154:> uname -m 2026-02-13T02:30:56.485 INFO:teuthology.orchestra.run.trial154.stdout:x86_64 2026-02-13T02:30:56.485 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release 2026-02-13T02:30:56.541 INFO:teuthology.orchestra.run.trial154.stdout:NAME="CentOS Stream" 2026-02-13T02:30:56.541 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="9" 2026-02-13T02:30:56.541 INFO:teuthology.orchestra.run.trial154.stdout:ID="centos" 2026-02-13T02:30:56.541 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel fedora" 2026-02-13T02:30:56.541 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="9" 2026-02-13T02:30:56.541 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el9" 2026-02-13T02:30:56.541 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T02:30:56.542 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;31" 2026-02-13T02:30:56.542 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon" 2026-02-13T02:30:56.542 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T02:30:56.542 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://centos.org/" 2026-02-13T02:30:56.542 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T02:30:56.542 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T02:30:56.542 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T02:30:56.542 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server 2026-02-13T02:30:56.617 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T02:30:56.631 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T02:30:56.643 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T02:30:56.643 DEBUG:teuthology.orchestra.run.trial078:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:30:56.645 DEBUG:teuthology.orchestra.run.trial091:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:30:56.646 DEBUG:teuthology.orchestra.run.trial154:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:30:56.661 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T02:30:56.673 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T02:30:56.673 DEBUG:teuthology.orchestra.run.trial078:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:30:56.699 DEBUG:teuthology.orchestra.run.trial091:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:30:56.703 DEBUG:teuthology.orchestra.run.trial154:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:30:56.720 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T02:30:56.943 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T02:30:56.962 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'sha1': 'distro'} 2026-02-13T02:30:56.962 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2026-02-13T02:30:56.962 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2026-02-13T02:30:56.962 DEBUG:teuthology.orchestra.run.trial078:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:30:56.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:30:56.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2026-02-13T02:30:57.116 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T02:30:57.116 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-13T02:30:57.116 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-13T02:30:57.131 INFO:teuthology.orchestra.run.trial078.stdout:5.14.0-645.el9.x86_64 2026-02-13T02:30:57.131 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T02:30:57.132 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-13T02:30:57.132 DEBUG:teuthology.orchestra.run.trial078:> sudo yum upgrade -y linux-firmware 2026-02-13T02:30:58.629 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.9 MB 00:01 2026-02-13T02:31:19.093 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 27 MB 00:19 2026-02-13T02:31:22.421 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 7.8 MB 00:00 2026-02-13T02:31:24.176 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-13T02:31:25.082 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-13T02:31:28.326 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-13T02:31:29.409 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout: linux-firmware noarch 20260130-160.el9 baseos 610 M 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 1 Package 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 610 M 2026-02-13T02:31:29.410 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-13T02:32:30.216 INFO:teuthology.orchestra.run.trial078.stdout:linux-firmware-20260130-160.el9.noarch.rpm 10 MB/s | 610 MB 01:00 2026-02-13T02:32:30.216 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:32:30.216 INFO:teuthology.orchestra.run.trial078.stdout:Total 10 MB/s | 610 MB 01:00 2026-02-13T02:32:31.276 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-13T02:32:31.293 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-13T02:32:31.293 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-13T02:32:33.137 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-13T02:32:33.137 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-13T02:32:34.958 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: linux-firmware-20260130-160.el9.noarch 1/1 2026-02-13T02:32:36.918 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-13T02:32:36.945 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T02:32:36.968 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T02:32:37.050 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T02:32:37.050 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T02:32:37.101 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T02:32:37.101 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:32:37.101 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-13T02:32:37.102 INFO:teuthology.orchestra.run.trial078.stdout: linux-firmware-20260130-160.el9.noarch 2026-02-13T02:32:37.102 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:32:37.102 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-13T02:32:37.193 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T02:32:37.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T02:32:37.371 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-13T02:32:37.371 DEBUG:teuthology.orchestra.run.trial078:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-13T02:32:37.373 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial078.front.sepia.ceph.com to complete... 2026-02-13T02:32:54.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13 02:32:54 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-13T02:32:54.381 INFO:teuthology.orchestra.run.trial078.stderr:FINISHED --2026-02-13 02:32:54-- 2026-02-13T02:32:54.381 INFO:teuthology.orchestra.run.trial078.stderr:Total wall clock time: 17s 2026-02-13T02:32:54.381 INFO:teuthology.orchestra.run.trial078.stderr:Downloaded: 1 files, 370M in 17s (22.1 MB/s) 2026-02-13T02:32:54.385 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T02:32:54.385 DEBUG:teuthology.orchestra.run.trial078:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-13T02:32:55.514 INFO:teuthology.orchestra.run.trial078.stdout:Verifying... ######################################## 2026-02-13T02:32:55.541 INFO:teuthology.orchestra.run.trial078.stdout:Preparing... ######################################## 2026-02-13T02:32:55.554 INFO:teuthology.orchestra.run.trial078.stdout:Updating / installing... 2026-02-13T02:32:58.746 INFO:teuthology.orchestra.run.trial078.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-13T02:33:14.262 INFO:teuthology.orchestra.run.trial078.stderr:sed: can't read /lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac: No such file or directory 2026-02-13T02:33:14.262 INFO:teuthology.orchestra.run.trial078.stderr:Can't create '/boot/.vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566.hmac' from '/lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac'! 2026-02-13T02:34:05.563 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial078.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-13T02:34:05.563 DEBUG:teuthology.orchestra.run.trial078:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-13T02:34:05.608 INFO:teuthology.orchestra.run.trial078.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-13T02:34:05.608 INFO:teuthology.orchestra.run.trial078.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-13T02:34:05.608 INFO:teuthology.orchestra.run.trial078.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-13T02:34:05.609 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-13T02:34:05.610 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-13T02:34:05.611 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-13T02:34:05.612 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-13T02:34:05.613 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-13T02:34:05.614 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-13T02:34:05.615 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-13T02:34:05.616 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-13T02:34:05.617 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-13T02:34:05.618 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-13T02:34:05.619 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-13T02:34:05.620 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-13T02:34:05.621 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-13T02:34:05.622 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-13T02:34:05.623 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-13T02:34:05.624 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-13T02:34:05.625 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-13T02:34:05.626 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-13T02:34:05.627 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-13T02:34:05.628 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-13T02:34:05.629 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-13T02:34:05.630 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-13T02:34:05.631 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-13T02:34:05.632 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-13T02:34:05.633 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-13T02:34:05.634 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-13T02:34:05.635 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-13T02:34:05.636 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-13T02:34:05.637 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-13T02:34:05.638 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-13T02:34:05.639 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-13T02:34:05.640 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-13T02:34:05.641 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-13T02:34:05.642 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-13T02:34:05.643 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-13T02:34:05.644 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-13T02:34:05.645 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-13T02:34:05.646 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-13T02:34:05.647 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-13T02:34:05.648 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-13T02:34:05.649 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-13T02:34:05.650 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-13T02:34:05.651 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-13T02:34:05.652 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-13T02:34:05.653 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-13T02:34:05.654 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-13T02:34:05.655 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-13T02:34:05.656 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-13T02:34:05.657 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-13T02:34:05.658 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-13T02:34:05.659 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-13T02:34:05.660 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-13T02:34:05.661 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-13T02:34:05.662 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-13T02:34:05.663 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-13T02:34:05.664 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-13T02:34:05.665 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-13T02:34:05.666 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-13T02:34:05.667 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-13T02:34:05.668 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-13T02:34:05.669 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-13T02:34:05.670 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-13T02:34:05.671 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-13T02:34:05.672 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-13T02:34:05.673 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-13T02:34:05.674 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-13T02:34:05.675 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-13T02:34:05.676 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-13T02:34:05.677 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-13T02:34:05.678 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-13T02:34:05.679 INFO:teuthology.orchestra.run.trial078.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T02:34:05.681 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-13T02:34:05.681 DEBUG:teuthology.orchestra.run.trial078:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:postinstall scriptlet (using /bin/sh): 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:fi 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:for file in vmlinuz System.map config; do 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout: fi 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:done 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:fi 2026-02-13T02:34:05.701 INFO:teuthology.orchestra.run.trial078.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-13T02:34:05.702 INFO:teuthology.orchestra.run.trial078.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-13T02:34:05.702 INFO:teuthology.orchestra.run.trial078.stdout:fi 2026-02-13T02:34:05.702 INFO:teuthology.orchestra.run.trial078.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-13T02:34:05.702 INFO:teuthology.orchestra.run.trial078.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T02:34:05.702 INFO:teuthology.orchestra.run.trial078.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-13T02:34:05.702 INFO:teuthology.orchestra.run.trial078.stdout:fi 2026-02-13T02:34:05.702 DEBUG:teuthology.orchestra.run.trial078:> sudo rpm -qi grub2-tools 2026-02-13T02:34:05.769 INFO:teuthology.orchestra.run.trial078.stdout:Name : grub2-tools 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Epoch : 1 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Version : 2.06 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Release : 118.el9 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Architecture: x86_64 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Group : Unspecified 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Size : 8393909 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:License : GPLv3+ 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T02:34:05.770 INFO:teuthology.orchestra.run.trial078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:Packager : builder@centos.org 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:Vendor : CentOS 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:Summary : Support tools for GRUB. 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:Description : 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:hardware devices. 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:34:05.771 INFO:teuthology.orchestra.run.trial078.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T02:34:05.772 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T02:34:05.772 INFO:teuthology.task.kernel:Updating grub on trial078 to boot 6.19.0-g8dec4b357aab 2026-02-13T02:34:05.772 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T02:34:05.836 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T02:34:05.838 DEBUG:teuthology.orchestra.run.trial078:> sudo command -v grubby && echo yes || echo no 2026-02-13T02:34:05.903 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/grubby 2026-02-13T02:34:05.904 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-13T02:34:05.905 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-13T02:34:05.969 INFO:teuthology.orchestra.run.trial078.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-13T02:34:05.970 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-13T02:34:06.043 DEBUG:teuthology.orchestra.run.trial078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T02:34:06.256 INFO:teuthology.orchestra.run.trial078.stderr:Generating grub configuration file ... 2026-02-13T02:34:06.319 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T02:34:06.325 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-13T02:34:06.577 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T02:34:06.584 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T02:34:06.616 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T02:34:06.622 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T02:34:06.645 INFO:teuthology.orchestra.run.trial078.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T02:34:06.652 INFO:teuthology.orchestra.run.trial078.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T02:34:06.734 INFO:teuthology.orchestra.run.trial078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T02:34:06.742 INFO:teuthology.orchestra.run.trial078.stderr:done 2026-02-13T02:34:06.744 DEBUG:teuthology.orchestra.run.trial078:> test -d /sys/firmware/efi 2026-02-13T02:34:06.760 DEBUG:teuthology.orchestra.run.trial078:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T02:34:06.825 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/BOOT 2026-02-13T02:34:06.825 INFO:teuthology.orchestra.run.trial078.stdout:/boot/efi/EFI/centos 2026-02-13T02:34:06.827 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T02:34:06.891 INFO:teuthology.orchestra.run.trial078.stdout:no 2026-02-13T02:34:06.892 DEBUG:teuthology.orchestra.run.trial078:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T02:34:06.956 INFO:teuthology.orchestra.run.trial078.stdout:yes 2026-02-13T02:34:06.956 DEBUG:teuthology.orchestra.run.trial078:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T02:34:07.022 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial078 2026-02-13T02:34:07.023 DEBUG:teuthology.orchestra.run.trial078:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T02:34:37.066 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-13T02:34:37.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T02:34:37.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:35:37.070 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T02:35:46.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T02:35:46.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:35:46.222 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-13T02:35:46.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T02:35:46.476 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.19.0-g8dec4b357aab"... 2026-02-13T02:35:46.476 DEBUG:teuthology.orchestra.run.trial078:> uname -r 2026-02-13T02:35:46.553 INFO:teuthology.orchestra.run.trial078.stdout:6.19.0-g8dec4b357aab 2026-02-13T02:35:46.554 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-13T02:35:46.554 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T02:35:46.554 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T02:35:47.558 DEBUG:teuthology.parallel:result is None 2026-02-13T02:35:47.558 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T02:35:47.571 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T02:35:47.571 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:35:47.575 DEBUG:teuthology.orchestra.run.trial091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:35:47.578 DEBUG:teuthology.orchestra.run.trial154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:35:47.610 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T02:35:47.622 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T02:35:47.636 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T02:35:47.636 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:35:47.653 DEBUG:teuthology.orchestra.run.trial091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:35:47.656 DEBUG:teuthology.orchestra.run.trial154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:35:47.700 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T02:35:47.712 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T02:35:47.712 DEBUG:teuthology.orchestra.run.trial091:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:35:47.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:35:47.727 DEBUG:teuthology.orchestra.run.trial154:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:35:47.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:35:47.741 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:35:47.744 DEBUG:teuthology.orchestra.run.trial091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:35:47.769 DEBUG:teuthology.orchestra.run.trial154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:35:47.793 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:35:47.802 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:35:47.805 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:35:47.808 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:35:47.816 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:35:47.826 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:35:47.829 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T02:35:47.841 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T02:35:47.841 DEBUG:teuthology.orchestra.run.trial078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:35:47.844 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:35:47.847 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:35:47.897 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T02:35:47.913 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T02:35:47.913 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:35:47.917 DEBUG:teuthology.orchestra.run.trial091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:35:47.920 DEBUG:teuthology.orchestra.run.trial154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:35:47.952 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:35:48.139 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:35:48.195 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:35:48.338 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:35:48.393 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:35:48.393 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:35:48.448 DEBUG:teuthology.orchestra.run.trial091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:35:48.568 DEBUG:teuthology.orchestra.run.trial091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:35:48.593 DEBUG:teuthology.orchestra.run.trial091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:35:48.739 DEBUG:teuthology.orchestra.run.trial091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:35:48.764 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:35:48.764 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:35:48.827 DEBUG:teuthology.orchestra.run.trial154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:35:48.945 DEBUG:teuthology.orchestra.run.trial154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:35:48.970 DEBUG:teuthology.orchestra.run.trial154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:35:49.115 DEBUG:teuthology.orchestra.run.trial154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:35:49.140 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:35:49.140 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:35:49.203 DEBUG:teuthology.orchestra.run.trial078:> sudo service rsyslog restart 2026-02-13T02:35:49.207 DEBUG:teuthology.orchestra.run.trial091:> sudo service rsyslog restart 2026-02-13T02:35:49.209 DEBUG:teuthology.orchestra.run.trial154:> sudo service rsyslog restart 2026-02-13T02:35:49.236 INFO:teuthology.orchestra.run.trial091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:35:49.268 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:35:49.272 INFO:teuthology.orchestra.run.trial154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:35:49.795 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T02:35:49.806 INFO:teuthology.task.internal:Starting timer... 2026-02-13T02:35:49.806 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T02:35:49.824 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T02:35:49.837 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T02:35:49.837 DEBUG:teuthology.orchestra.run.trial078:> sudo service auditd rotate 2026-02-13T02:35:49.903 INFO:teuthology.orchestra.run.trial078.stdout:Rotating logs: 2026-02-13T02:35:49.906 DEBUG:teuthology.orchestra.run.trial091:> sudo service auditd rotate 2026-02-13T02:35:49.936 INFO:teuthology.orchestra.run.trial091.stdout:Rotating logs: 2026-02-13T02:35:49.937 DEBUG:teuthology.orchestra.run.trial154:> sudo service auditd rotate 2026-02-13T02:35:49.966 INFO:teuthology.orchestra.run.trial154.stdout:Rotating logs: 2026-02-13T02:35:49.968 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T02:35:49.968 DEBUG:teuthology.orchestra.run.trial078:> /usr/sbin/getenforce 2026-02-13T02:35:50.005 INFO:teuthology.orchestra.run.trial078.stdout:Permissive 2026-02-13T02:35:50.006 DEBUG:teuthology.orchestra.run.trial091:> /usr/sbin/getenforce 2026-02-13T02:35:50.022 INFO:teuthology.orchestra.run.trial091.stdout:Permissive 2026-02-13T02:35:50.022 DEBUG:teuthology.orchestra.run.trial154:> /usr/sbin/getenforce 2026-02-13T02:35:50.039 INFO:teuthology.orchestra.run.trial154.stdout:Permissive 2026-02-13T02:35:50.039 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial078.front.sepia.ceph.com': 'permissive', 'ubuntu@trial091.front.sepia.ceph.com': 'permissive', 'ubuntu@trial154.front.sepia.ceph.com': 'permissive'} 2026-02-13T02:35:50.039 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T02:35:50.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:35:50.103 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T02:35:50.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:35:50.129 DEBUG:teuthology.orchestra.run.trial154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T02:35:50.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:35:50.155 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T02:35:50.155 DEBUG:teuthology.orchestra.run.trial078:> sudo /usr/sbin/setenforce permissive 2026-02-13T02:35:50.211 DEBUG:teuthology.orchestra.run.trial091:> sudo /usr/sbin/setenforce permissive 2026-02-13T02:35:50.236 DEBUG:teuthology.orchestra.run.trial154:> sudo /usr/sbin/setenforce permissive 2026-02-13T02:35:50.262 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T02:35:50.277 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T02:35:50.288 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T02:35:50.289 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial078.front.sepia.ceph.com,trial091.front.sepia.ceph.com,trial154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T02:37:18.793 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial078.front.sepia.ceph.com'), Remote(name='ubuntu@trial091.front.sepia.ceph.com'), Remote(name='ubuntu@trial154.front.sepia.ceph.com')] 2026-02-13T02:37:18.803 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T02:37:18.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:37:18.918 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-13T02:37:19.021 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T02:37:19.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T02:37:19.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:37:19.128 DEBUG:teuthology.orchestra.run.trial091:> true 2026-02-13T02:37:19.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T02:37:19.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-13T02:37:19.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:37:19.306 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-13T02:37:19.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-13T02:37:19.383 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T02:37:19.397 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T02:37:19.397 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:37:19.397 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:37:19.400 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:37:19.401 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:37:19.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:37:19.403 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:37:19.430 INFO:teuthology.orchestra.run.trial091.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T02:37:19.442 INFO:teuthology.orchestra.run.trial091.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T02:37:19.452 INFO:teuthology.orchestra.run.trial154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T02:37:19.457 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T02:37:19.463 INFO:teuthology.orchestra.run.trial091.stderr:sudo: ntpd: command not found 2026-02-13T02:37:19.464 INFO:teuthology.orchestra.run.trial154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T02:37:19.472 INFO:teuthology.orchestra.run.trial091.stdout:506 Cannot talk to daemon 2026-02-13T02:37:19.483 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T02:37:19.483 INFO:teuthology.orchestra.run.trial091.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T02:37:19.485 INFO:teuthology.orchestra.run.trial154.stderr:sudo: ntpd: command not found 2026-02-13T02:37:19.494 INFO:teuthology.orchestra.run.trial154.stdout:506 Cannot talk to daemon 2026-02-13T02:37:19.495 INFO:teuthology.orchestra.run.trial091.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T02:37:19.505 INFO:teuthology.orchestra.run.trial154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T02:37:19.517 INFO:teuthology.orchestra.run.trial154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T02:37:19.526 INFO:teuthology.orchestra.run.trial078.stderr:sudo: ntpd: command not found 2026-02-13T02:37:19.538 INFO:teuthology.orchestra.run.trial091.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:37:19.547 INFO:teuthology.orchestra.run.trial078.stdout:506 Cannot talk to daemon 2026-02-13T02:37:19.557 INFO:teuthology.orchestra.run.trial091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:37:19.557 INFO:teuthology.orchestra.run.trial091.stdout:=============================================================================== 2026-02-13T02:37:19.557 INFO:teuthology.orchestra.run.trial091.stdout:^? 157.245.125.229 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.557 INFO:teuthology.orchestra.run.trial091.stdout:^? as393746.mci.trtnw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.557 INFO:teuthology.orchestra.run.trial091.stdout:^? 170-187-142-180.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.557 INFO:teuthology.orchestra.run.trial091.stdout:^? ntp.sfo.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.565 INFO:teuthology.orchestra.run.trial154.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:37:19.572 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T02:37:19.581 INFO:teuthology.orchestra.run.trial154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:37:19.581 INFO:teuthology.orchestra.run.trial154.stdout:=============================================================================== 2026-02-13T02:37:19.581 INFO:teuthology.orchestra.run.trial154.stdout:^? 38.45.64.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.581 INFO:teuthology.orchestra.run.trial154.stdout:^? ntp4.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.582 INFO:teuthology.orchestra.run.trial154.stdout:^? 136-55-44-51.googlefiber> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.582 INFO:teuthology.orchestra.run.trial154.stdout:^? kc1cloud.147.72.155.23.m> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.597 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T02:37:19.676 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:37:19.693 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:37:19.694 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-13T02:37:19.694 INFO:teuthology.orchestra.run.trial078.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.694 INFO:teuthology.orchestra.run.trial078.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.694 INFO:teuthology.orchestra.run.trial078.stdout:^? 107-172-222-7-host.coloc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.694 INFO:teuthology.orchestra.run.trial078.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:37:19.695 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T02:37:19.713 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T02:37:19.714 DEBUG:teuthology.orchestra.run.trial078:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T02:37:19.715 DEBUG:teuthology.orchestra.run.trial091:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T02:37:19.715 DEBUG:teuthology.orchestra.run.trial154:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T02:37:19.718 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial091.front.sepia.ceph.com 2026-02-13T02:37:19.719 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T02:37:19.719 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T02:37:19.721 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial078.front.sepia.ceph.com 2026-02-13T02:37:19.721 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T02:37:19.721 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T02:37:19.722 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial154.front.sepia.ceph.com 2026-02-13T02:37:19.722 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T02:37:19.722 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T02:37:19.883 INFO:teuthology.orchestra.run.trial091.stdout:No match for argument: nvme-cli 2026-02-13T02:37:19.883 INFO:teuthology.orchestra.run.trial091.stderr:No packages marked for removal. 2026-02-13T02:37:19.885 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-13T02:37:19.886 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-13T02:37:19.886 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-13T02:37:19.889 INFO:teuthology.orchestra.run.trial154.stdout:No match for argument: nvme-cli 2026-02-13T02:37:19.889 INFO:teuthology.orchestra.run.trial154.stderr:No packages marked for removal. 2026-02-13T02:37:19.891 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-13T02:37:19.892 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-13T02:37:19.892 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-13T02:37:19.957 INFO:teuthology.orchestra.run.trial078.stdout:No match for argument: nvme-cli 2026-02-13T02:37:19.957 INFO:teuthology.orchestra.run.trial078.stderr:No packages marked for removal. 2026-02-13T02:37:19.960 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-13T02:37:19.961 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-13T02:37:19.961 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-13T02:37:20.176 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:35 ago on Fri 13 Feb 2026 02:36:45 AM UTC. 2026-02-13T02:37:20.180 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:37 ago on Fri 13 Feb 2026 02:36:43 AM UTC. 2026-02-13T02:37:20.259 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout: Package Architecture Version Repository Size 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout:Upgrading: 2026-02-13T02:37:20.260 INFO:teuthology.orchestra.run.trial091.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout:Install 6 Packages 2026-02-13T02:37:20.261 INFO:teuthology.orchestra.run.trial091.stdout:Upgrade 1 Package 2026-02-13T02:37:20.262 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:37:20.262 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 2.4 M 2026-02-13T02:37:20.262 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-13T02:37:20.262 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-13T02:37:20.263 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T02:37:20.263 INFO:teuthology.orchestra.run.trial154.stdout: Package Architecture Version Repository Size 2026-02-13T02:37:20.263 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout:Upgrading: 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T02:37:20.264 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:37:20.265 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-13T02:37:20.265 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T02:37:20.265 INFO:teuthology.orchestra.run.trial154.stdout:Install 6 Packages 2026-02-13T02:37:20.265 INFO:teuthology.orchestra.run.trial154.stdout:Upgrade 1 Package 2026-02-13T02:37:20.265 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:37:20.265 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 2.4 M 2026-02-13T02:37:20.265 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-13T02:37:20.424 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:39 ago on Fri 13 Feb 2026 02:36:41 AM UTC. 2026-02-13T02:37:20.512 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout: Package Architecture Version Repository Size 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-13T02:37:20.513 INFO:teuthology.orchestra.run.trial078.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout:Install 6 Packages 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 1 Package 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 2.4 M 2026-02-13T02:37:20.514 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-13T02:37:20.822 INFO:teuthology.orchestra.run.trial154.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 88 kB/s | 44 kB 00:00 2026-02-13T02:37:20.841 INFO:teuthology.orchestra.run.trial154.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 139 kB/s | 72 kB 00:00 2026-02-13T02:37:20.877 INFO:teuthology.orchestra.run.trial091.stdout:(1/7): python3-configshell-1.1.30-1.el9.noarch. 136 kB/s | 72 kB 00:00 2026-02-13T02:37:20.985 INFO:teuthology.orchestra.run.trial154.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 516 kB/s | 84 kB 00:00 2026-02-13T02:37:21.005 INFO:teuthology.orchestra.run.trial154.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 922 kB/s | 150 kB 00:00 2026-02-13T02:37:21.040 INFO:teuthology.orchestra.run.trial091.stdout:(2/7): python3-kmod-0.9-32.el9.x86_64.rpm 516 kB/s | 84 kB 00:00 2026-02-13T02:37:21.088 INFO:teuthology.orchestra.run.trial154.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2026-02-13T02:37:21.138 INFO:teuthology.orchestra.run.trial091.stdout:(3/7): nvmetcli-0.8-3.el9.noarch.rpm 56 kB/s | 44 kB 00:00 2026-02-13T02:37:21.241 INFO:teuthology.orchestra.run.trial078.stdout:(1/7): python3-configshell-1.1.30-1.el9.noarch. 108 kB/s | 72 kB 00:00 2026-02-13T02:37:21.271 INFO:teuthology.orchestra.run.trial078.stdout:(2/7): nvmetcli-0.8-3.el9.noarch.rpm 63 kB/s | 44 kB 00:00 2026-02-13T02:37:21.303 INFO:teuthology.orchestra.run.trial091.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 571 kB/s | 150 kB 00:00 2026-02-13T02:37:21.484 INFO:teuthology.orchestra.run.trial091.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 644 kB/s | 116 kB 00:00 2026-02-13T02:37:21.499 INFO:teuthology.orchestra.run.trial078.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 326 kB/s | 84 kB 00:00 2026-02-13T02:37:21.621 INFO:teuthology.orchestra.run.trial154.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 1.3 MB/s | 837 kB 00:00 2026-02-13T02:37:21.918 INFO:teuthology.orchestra.run.trial078.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 233 kB/s | 150 kB 00:00 2026-02-13T02:37:22.118 INFO:teuthology.orchestra.run.trial154.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 658 kB/s | 1.2 MB 00:01 2026-02-13T02:37:22.120 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:37:22.120 INFO:teuthology.orchestra.run.trial154.stdout:Total 1.3 MB/s | 2.4 MB 00:01 2026-02-13T02:37:22.167 INFO:teuthology.orchestra.run.trial078.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 469 kB/s | 116 kB 00:00 2026-02-13T02:37:22.181 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-13T02:37:22.185 INFO:teuthology.orchestra.run.trial078.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 1.2 MB/s | 837 kB 00:00 2026-02-13T02:37:22.189 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-13T02:37:22.189 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-13T02:37:22.250 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-13T02:37:22.250 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-13T02:37:22.258 INFO:teuthology.orchestra.run.trial091.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 747 kB/s | 837 kB 00:01 2026-02-13T02:37:22.318 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-13T02:37:22.385 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T02:37:22.392 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T02:37:22.401 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T02:37:22.406 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T02:37:22.412 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T02:37:22.413 INFO:teuthology.orchestra.run.trial154.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T02:37:22.474 INFO:teuthology.orchestra.run.trial078.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 621 kB/s | 1.2 MB 00:01 2026-02-13T02:37:22.476 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:37:22.476 INFO:teuthology.orchestra.run.trial078.stdout:Total 1.2 MB/s | 2.4 MB 00:01 2026-02-13T02:37:22.547 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T02:37:22.549 INFO:teuthology.orchestra.run.trial154.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T02:37:22.587 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-13T02:37:22.597 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-13T02:37:22.598 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-13T02:37:22.684 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-13T02:37:22.684 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-13T02:37:22.773 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-13T02:37:22.832 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T02:37:22.832 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T02:37:22.832 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:37:22.856 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:22.868 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T02:37:22.882 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T02:37:22.896 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T02:37:22.905 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T02:37:22.914 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T02:37:22.916 INFO:teuthology.orchestra.run.trial078.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T02:37:23.063 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:23.063 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T02:37:23.063 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T02:37:23.063 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T02:37:23.063 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T02:37:23.063 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T02:37:23.063 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T02:37:23.064 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T02:37:23.085 INFO:teuthology.orchestra.run.trial091.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 431 kB/s | 1.2 MB 00:02 2026-02-13T02:37:23.087 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:37:23.087 INFO:teuthology.orchestra.run.trial091.stdout:Total 878 kB/s | 2.4 MB 00:02 2026-02-13T02:37:23.109 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T02:37:23.110 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:23.110 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:37:23.110 INFO:teuthology.orchestra.run.trial154.stdout:Upgraded: 2026-02-13T02:37:23.110 INFO:teuthology.orchestra.run.trial154.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T02:37:23.111 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-13T02:37:23.111 INFO:teuthology.orchestra.run.trial154.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T02:37:23.111 INFO:teuthology.orchestra.run.trial154.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T02:37:23.111 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T02:37:23.111 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:37:23.111 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-13T02:37:23.115 INFO:teuthology.orchestra.run.trial078.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T02:37:23.141 DEBUG:teuthology.parallel:result is None 2026-02-13T02:37:23.150 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-13T02:37:23.158 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-13T02:37:23.158 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-13T02:37:23.218 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-13T02:37:23.218 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-13T02:37:23.287 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-13T02:37:23.354 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T02:37:23.362 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T02:37:23.371 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T02:37:23.377 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T02:37:23.382 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T02:37:23.383 INFO:teuthology.orchestra.run.trial091.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T02:37:23.513 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T02:37:23.516 INFO:teuthology.orchestra.run.trial091.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T02:37:23.670 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T02:37:23.671 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T02:37:23.671 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:37:23.690 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:23.794 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T02:37:23.794 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T02:37:23.794 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:37:23.817 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:24.045 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:24.045 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T02:37:24.045 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T02:37:24.046 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T02:37:24.046 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T02:37:24.046 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T02:37:24.046 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T02:37:24.046 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T02:37:24.086 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:24.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T02:37:24.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T02:37:24.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T02:37:24.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T02:37:24.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T02:37:24.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T02:37:24.087 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout:Upgraded: 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T02:37:24.094 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T02:37:24.095 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:37:24.095 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-13T02:37:24.125 DEBUG:teuthology.parallel:result is None 2026-02-13T02:37:24.146 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T02:37:24.146 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:37:24.146 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-13T02:37:24.146 INFO:teuthology.orchestra.run.trial078.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T02:37:24.147 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-13T02:37:24.147 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T02:37:24.147 INFO:teuthology.orchestra.run.trial078.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T02:37:24.147 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T02:37:24.147 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:37:24.147 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-13T02:37:24.205 DEBUG:teuthology.parallel:result is None 2026-02-13T02:37:24.205 INFO:teuthology.run_tasks:Running task install... 2026-02-13T02:37:24.221 DEBUG:teuthology.task.install:project ceph 2026-02-13T02:37:24.221 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T02:37:24.221 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T02:37:24.221 INFO:teuthology.task.install:Using flavor: default 2026-02-13T02:37:24.231 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T02:37:24.231 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T02:37:24.231 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T02:37:24.232 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:37:24.234 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T02:37:24.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:37:24.236 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T02:37:24.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:37:24.474 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T02:37:24.474 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T02:37:24.476 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T02:37:24.476 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T02:37:24.483 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T02:37:24.483 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T02:37:24.670 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T02:37:24.670 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:37:24.670 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T02:37:24.672 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T02:37:24.672 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:37:24.672 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T02:37:24.678 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T02:37:24.678 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:37:24.679 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T02:37:24.700 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T02:37:24.700 DEBUG:teuthology.orchestra.run.trial154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T02:37:24.701 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T02:37:24.701 DEBUG:teuthology.orchestra.run.trial091:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T02:37:24.734 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T02:37:24.734 DEBUG:teuthology.orchestra.run.trial078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T02:37:24.767 DEBUG:teuthology.orchestra.run.trial091:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T02:37:24.768 DEBUG:teuthology.orchestra.run.trial154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T02:37:24.831 DEBUG:teuthology.orchestra.run.trial078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T02:37:24.840 DEBUG:teuthology.orchestra.run.trial091:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T02:37:24.841 DEBUG:teuthology.orchestra.run.trial154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T02:37:24.903 INFO:teuthology.orchestra.run.trial091.stdout:check_obsoletes = 1 2026-02-13T02:37:24.905 DEBUG:teuthology.orchestra.run.trial091:> sudo yum clean all 2026-02-13T02:37:24.906 DEBUG:teuthology.orchestra.run.trial078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T02:37:24.908 INFO:teuthology.orchestra.run.trial154.stdout:check_obsoletes = 1 2026-02-13T02:37:24.909 DEBUG:teuthology.orchestra.run.trial154:> sudo yum clean all 2026-02-13T02:37:24.963 INFO:teuthology.orchestra.run.trial078.stdout:check_obsoletes = 1 2026-02-13T02:37:24.966 DEBUG:teuthology.orchestra.run.trial078:> sudo yum clean all 2026-02-13T02:37:25.065 INFO:teuthology.orchestra.run.trial091.stdout:41 files removed 2026-02-13T02:37:25.066 INFO:teuthology.orchestra.run.trial154.stdout:41 files removed 2026-02-13T02:37:25.081 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T02:37:25.082 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T02:37:25.137 INFO:teuthology.orchestra.run.trial078.stdout:41 files removed 2026-02-13T02:37:25.156 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T02:37:25.347 INFO:teuthology.orchestra.run.trial091.stdout:ceph packages for x86_64 732 kB/s | 91 kB 00:00 2026-02-13T02:37:25.353 INFO:teuthology.orchestra.run.trial154.stdout:ceph packages for x86_64 700 kB/s | 91 kB 00:00 2026-02-13T02:37:25.484 INFO:teuthology.orchestra.run.trial091.stdout:ceph noarch packages 202 kB/s | 23 kB 00:00 2026-02-13T02:37:25.485 INFO:teuthology.orchestra.run.trial154.stdout:ceph noarch packages 213 kB/s | 23 kB 00:00 2026-02-13T02:37:25.517 INFO:teuthology.orchestra.run.trial078.stdout:ceph packages for x86_64 695 kB/s | 91 kB 00:00 2026-02-13T02:37:25.604 INFO:teuthology.orchestra.run.trial091.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T02:37:25.606 INFO:teuthology.orchestra.run.trial154.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T02:37:25.658 INFO:teuthology.orchestra.run.trial078.stdout:ceph noarch packages 199 kB/s | 23 kB 00:00 2026-02-13T02:37:25.788 INFO:teuthology.orchestra.run.trial078.stdout:ceph source packages 18 kB/s | 2.1 kB 00:00 2026-02-13T02:37:26.321 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-13T02:37:32.253 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.9 MB 00:06 2026-02-13T02:37:32.660 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.9 MB 00:06 2026-02-13T02:37:35.349 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-13T02:37:36.351 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 27 MB 00:03 2026-02-13T02:37:37.844 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 27 MB 00:10 2026-02-13T02:37:39.119 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 7.8 MB 00:01 2026-02-13T02:37:40.013 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-13T02:37:40.985 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-13T02:37:41.043 INFO:teuthology.orchestra.run.trial078.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 20 kB 00:00 2026-02-13T02:37:41.627 INFO:teuthology.orchestra.run.trial091.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-13T02:37:41.710 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-13T02:37:42.202 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 7.8 MB 00:01 2026-02-13T02:37:43.014 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - Extras packages 229 kB/s | 20 kB 00:00 2026-02-13T02:37:43.998 INFO:teuthology.orchestra.run.trial154.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-13T02:37:44.849 INFO:teuthology.orchestra.run.trial091.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T02:37:45.921 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-13T02:37:46.103 INFO:teuthology.orchestra.run.trial091.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T02:37:46.103 INFO:teuthology.orchestra.run.trial091.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T02:37:46.109 INFO:teuthology.orchestra.run.trial091.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T02:37:46.109 INFO:teuthology.orchestra.run.trial091.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T02:37:46.110 INFO:teuthology.orchestra.run.trial091.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T02:37:46.110 INFO:teuthology.orchestra.run.trial091.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T02:37:46.111 INFO:teuthology.orchestra.run.trial091.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T02:37:46.112 INFO:teuthology.orchestra.run.trial091.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T02:37:46.112 INFO:teuthology.orchestra.run.trial091.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T02:37:46.140 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-13T02:37:46.144 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-13T02:37:46.144 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repository Size 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T02:37:46.145 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T02:37:46.146 INFO:teuthology.orchestra.run.trial091.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T02:37:46.147 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout:Upgrading: 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T02:37:46.148 INFO:teuthology.orchestra.run.trial091.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T02:37:46.149 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T02:37:46.150 INFO:teuthology.orchestra.run.trial091.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T02:37:46.151 INFO:teuthology.orchestra.run.trial091.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T02:37:46.152 INFO:teuthology.orchestra.run.trial091.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T02:37:46.153 INFO:teuthology.orchestra.run.trial091.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T02:37:46.154 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T02:37:46.155 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T02:37:46.156 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T02:37:46.157 INFO:teuthology.orchestra.run.trial091.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout:Installing weak dependencies: 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:37:46.158 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-13T02:37:46.159 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-13T02:37:46.159 INFO:teuthology.orchestra.run.trial091.stdout:Install 162 Packages 2026-02-13T02:37:46.159 INFO:teuthology.orchestra.run.trial091.stdout:Upgrade 11 Packages 2026-02-13T02:37:46.159 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:37:46.159 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 302 M 2026-02-13T02:37:46.160 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-13T02:37:46.529 INFO:teuthology.orchestra.run.trial091.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 78 kB/s | 6.5 kB 00:00 2026-02-13T02:37:46.650 INFO:teuthology.orchestra.run.trial091.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 8.0 MB/s | 987 kB 00:00 2026-02-13T02:37:46.697 INFO:teuthology.orchestra.run.trial091.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 3.0 MB/s | 147 kB 00:00 2026-02-13T02:37:46.812 INFO:teuthology.orchestra.run.trial091.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 14 MB/s | 5.2 MB 00:00 2026-02-13T02:37:46.873 INFO:teuthology.orchestra.run.trial091.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 15 MB/s | 940 kB 00:00 2026-02-13T02:37:46.913 INFO:teuthology.orchestra.run.trial091.stdout:(6/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 11 MB/s | 2.4 MB 00:00 2026-02-13T02:37:46.970 INFO:teuthology.orchestra.run.trial091.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 2.9 MB/s | 166 kB 00:00 2026-02-13T02:37:47.179 INFO:teuthology.orchestra.run.trial091.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 16 MB/s | 5.0 MB 00:00 2026-02-13T02:37:47.253 INFO:teuthology.orchestra.run.trial154.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T02:37:47.262 INFO:teuthology.orchestra.run.trial078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T02:37:47.262 INFO:teuthology.orchestra.run.trial078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T02:37:47.268 INFO:teuthology.orchestra.run.trial078.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T02:37:47.269 INFO:teuthology.orchestra.run.trial078.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T02:37:47.269 INFO:teuthology.orchestra.run.trial078.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T02:37:47.270 INFO:teuthology.orchestra.run.trial078.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T02:37:47.270 INFO:teuthology.orchestra.run.trial078.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T02:37:47.272 INFO:teuthology.orchestra.run.trial078.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T02:37:47.272 INFO:teuthology.orchestra.run.trial078.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T02:37:47.302 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================= 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================= 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T02:37:47.307 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T02:37:47.308 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T02:37:47.309 INFO:teuthology.orchestra.run.trial078.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T02:37:47.310 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T02:37:47.311 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T02:37:47.312 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T02:37:47.313 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T02:37:47.314 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout:Installing weak dependencies: 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================= 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout:Install 162 Packages 2026-02-13T02:37:47.315 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 11 Packages 2026-02-13T02:37:47.316 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:37:47.316 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 302 M 2026-02-13T02:37:47.316 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-13T02:37:47.350 INFO:teuthology.orchestra.run.trial091.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 27 MB/s | 24 MB 00:00 2026-02-13T02:37:47.844 INFO:teuthology.orchestra.run.trial091.stdout:(10/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 27 MB/s | 13 MB 00:00 2026-02-13T02:37:47.874 INFO:teuthology.orchestra.run.trial091.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 849 kB/s | 25 kB 00:00 2026-02-13T02:37:48.145 INFO:teuthology.orchestra.run.trial078.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2026-02-13T02:37:48.165 INFO:teuthology.orchestra.run.trial091.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 19 MB/s | 19 MB 00:00 2026-02-13T02:37:48.214 INFO:teuthology.orchestra.run.trial091.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 4.8 MB/s | 243 kB 00:00 2026-02-13T02:37:48.275 INFO:teuthology.orchestra.run.trial091.stdout:(14/173): ceph-osd-classic-20.3.0-5241.g8f8d382 12 MB/s | 16 MB 00:01 2026-02-13T02:37:48.275 INFO:teuthology.orchestra.run.trial091.stdout:(15/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 448 kB/s | 27 kB 00:00 2026-02-13T02:37:48.313 INFO:teuthology.orchestra.run.trial091.stdout:(16/173): libcephfs-devel-20.3.0-5241.g8f8d3829 966 kB/s | 37 kB 00:00 2026-02-13T02:37:48.314 INFO:teuthology.orchestra.run.trial091.stdout:(17/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 634 kB/s | 24 kB 00:00 2026-02-13T02:37:48.373 INFO:teuthology.orchestra.run.trial091.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 2.6 MB/s | 159 kB 00:00 2026-02-13T02:37:48.435 INFO:teuthology.orchestra.run.trial091.stdout:(19/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 7.3 MB/s | 909 kB 00:00 2026-02-13T02:37:48.438 INFO:teuthology.orchestra.run.trial091.stdout:(20/173): librados-devel-20.3.0-5241.g8f8d3829. 1.9 MB/s | 123 kB 00:00 2026-02-13T02:37:48.500 INFO:teuthology.orchestra.run.trial091.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 3.7 MB/s | 248 kB 00:00 2026-02-13T02:37:48.514 INFO:teuthology.orchestra.run.trial154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T02:37:48.514 INFO:teuthology.orchestra.run.trial154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T02:37:48.520 INFO:teuthology.orchestra.run.trial154.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T02:37:48.521 INFO:teuthology.orchestra.run.trial154.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T02:37:48.521 INFO:teuthology.orchestra.run.trial154.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T02:37:48.522 INFO:teuthology.orchestra.run.trial154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T02:37:48.523 INFO:teuthology.orchestra.run.trial154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T02:37:48.524 INFO:teuthology.orchestra.run.trial154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T02:37:48.524 INFO:teuthology.orchestra.run.trial154.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T02:37:48.551 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-13T02:37:48.556 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-13T02:37:48.556 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repository Size 2026-02-13T02:37:48.556 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-13T02:37:48.556 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T02:37:48.557 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T02:37:48.558 INFO:teuthology.orchestra.run.trial154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T02:37:48.559 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout:Upgrading: 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T02:37:48.560 INFO:teuthology.orchestra.run.trial154.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T02:37:48.561 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T02:37:48.562 INFO:teuthology.orchestra.run.trial154.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T02:37:48.563 INFO:teuthology.orchestra.run.trial154.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T02:37:48.564 INFO:teuthology.orchestra.run.trial154.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T02:37:48.565 INFO:teuthology.orchestra.run.trial154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T02:37:48.566 INFO:teuthology.orchestra.run.trial154.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T02:37:48.567 INFO:teuthology.orchestra.run.trial154.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T02:37:48.568 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T02:37:48.569 INFO:teuthology.orchestra.run.trial154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T02:37:48.570 INFO:teuthology.orchestra.run.trial154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout:Installing weak dependencies: 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout:Install 162 Packages 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout:Upgrade 11 Packages 2026-02-13T02:37:48.571 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:37:48.572 INFO:teuthology.orchestra.run.trial091.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 673 kB/s | 45 kB 00:00 2026-02-13T02:37:48.572 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 302 M 2026-02-13T02:37:48.572 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-13T02:37:48.629 INFO:teuthology.orchestra.run.trial091.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 2.9 MB/s | 185 kB 00:00 2026-02-13T02:37:48.687 INFO:teuthology.orchestra.run.trial091.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 3.5 MB/s | 204 kB 00:00 2026-02-13T02:37:48.750 INFO:teuthology.orchestra.run.trial091.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 5.0 MB/s | 324 kB 00:00 2026-02-13T02:37:48.779 INFO:teuthology.orchestra.run.trial078.stdout:(2/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 5.9 MB/s | 5.2 MB 00:00 2026-02-13T02:37:48.805 INFO:teuthology.orchestra.run.trial091.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 5.5 MB/s | 306 kB 00:00 2026-02-13T02:37:48.834 INFO:teuthology.orchestra.run.trial078.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 2.6 MB/s | 147 kB 00:00 2026-02-13T02:37:48.857 INFO:teuthology.orchestra.run.trial091.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.9 MB/s | 100 kB 00:00 2026-02-13T02:37:48.916 INFO:teuthology.orchestra.run.trial091.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.4 MB/s | 84 kB 00:00 2026-02-13T02:37:49.045 INFO:teuthology.orchestra.run.trial091.stdout:(29/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 11 MB/s | 6.5 MB 00:00 2026-02-13T02:37:49.066 INFO:teuthology.orchestra.run.trial078.stdout:(4/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.0 MB/s | 987 kB 00:00 2026-02-13T02:37:49.081 INFO:teuthology.orchestra.run.trial078.stdout:(5/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 9.6 MB/s | 2.4 MB 00:00 2026-02-13T02:37:49.099 INFO:teuthology.orchestra.run.trial091.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 3.1 MB/s | 172 kB 00:00 2026-02-13T02:37:49.156 INFO:teuthology.orchestra.run.trial091.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.0 MB/s | 57 kB 00:00 2026-02-13T02:37:49.217 INFO:teuthology.orchestra.run.trial091.stdout:(32/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 9.5 MB/s | 2.9 MB 00:00 2026-02-13T02:37:49.217 INFO:teuthology.orchestra.run.trial091.stdout:(33/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 2.9 MB/s | 183 kB 00:00 2026-02-13T02:37:49.667 INFO:teuthology.orchestra.run.trial078.stdout:(6/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 8.5 MB/s | 5.0 MB 00:00 2026-02-13T02:37:49.727 INFO:teuthology.orchestra.run.trial078.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 2.7 MB/s | 166 kB 00:00 2026-02-13T02:37:49.831 INFO:teuthology.orchestra.run.trial154.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2026-02-13T02:37:49.886 INFO:teuthology.orchestra.run.trial091.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 11 MB/s | 7.4 MB 00:00 2026-02-13T02:37:49.889 INFO:teuthology.orchestra.run.trial078.stdout:(8/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 1.1 MB/s | 940 kB 00:00 2026-02-13T02:37:49.944 INFO:teuthology.orchestra.run.trial091.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 5.1 MB/s | 297 kB 00:00 2026-02-13T02:37:50.002 INFO:teuthology.orchestra.run.trial091.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 864 kB/s | 50 kB 00:00 2026-02-13T02:37:50.063 INFO:teuthology.orchestra.run.trial091.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 283 kB/s | 17 kB 00:00 2026-02-13T02:37:50.133 INFO:teuthology.orchestra.run.trial091.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 4.2 MB/s | 299 kB 00:00 2026-02-13T02:37:50.337 INFO:teuthology.orchestra.run.trial154.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.9 MB/s | 987 kB 00:00 2026-02-13T02:37:50.381 INFO:teuthology.orchestra.run.trial091.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 4.1 MB/s | 1.0 MB 00:00 2026-02-13T02:37:50.394 INFO:teuthology.orchestra.run.trial154.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 2.5 MB/s | 147 kB 00:00 2026-02-13T02:37:50.434 INFO:teuthology.orchestra.run.trial091.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 345 kB/s | 18 kB 00:00 2026-02-13T02:37:50.767 INFO:teuthology.orchestra.run.trial091.stdout:(41/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 9.6 MB/s | 15 MB 00:01 2026-02-13T02:37:50.830 INFO:teuthology.orchestra.run.trial154.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 5.4 MB/s | 2.4 MB 00:00 2026-02-13T02:37:50.864 INFO:teuthology.orchestra.run.trial078.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 8.2 MB/s | 24 MB 00:02 2026-02-13T02:37:50.927 INFO:teuthology.orchestra.run.trial154.stdout:(5/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 3.8 MB/s | 5.2 MB 00:01 2026-02-13T02:37:50.965 INFO:teuthology.orchestra.run.trial154.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 6.8 MB/s | 940 kB 00:00 2026-02-13T02:37:51.016 INFO:teuthology.orchestra.run.trial154.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 3.2 MB/s | 166 kB 00:00 2026-02-13T02:37:51.404 INFO:teuthology.orchestra.run.trial091.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 361 kB/s | 350 kB 00:00 2026-02-13T02:37:51.449 INFO:teuthology.orchestra.run.trial154.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 9.5 MB/s | 5.0 MB 00:00 2026-02-13T02:37:51.563 INFO:teuthology.orchestra.run.trial091.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 254 kB/s | 40 kB 00:00 2026-02-13T02:37:51.677 INFO:teuthology.orchestra.run.trial078.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 8.0 MB/s | 16 MB 00:01 2026-02-13T02:37:51.709 INFO:teuthology.orchestra.run.trial091.stdout:(44/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 20 MB/s | 78 MB 00:03 2026-02-13T02:37:51.722 INFO:teuthology.orchestra.run.trial078.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 562 kB/s | 25 kB 00:00 2026-02-13T02:37:51.789 INFO:teuthology.orchestra.run.trial091.stdout:(45/173): libatomic-11.5.0-14.el9.x86_64.rpm 101 kB/s | 23 kB 00:00 2026-02-13T02:37:51.950 INFO:teuthology.orchestra.run.trial091.stdout:(46/173): libconfig-1.7.2-9.el9.x86_64.rpm 299 kB/s | 72 kB 00:00 2026-02-13T02:37:52.266 INFO:teuthology.orchestra.run.trial091.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 584 kB/s | 184 kB 00:00 2026-02-13T02:37:52.392 INFO:teuthology.orchestra.run.trial154.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 8.5 MB/s | 24 MB 00:02 2026-02-13T02:37:52.504 INFO:teuthology.orchestra.run.trial091.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 395 kB/s | 94 kB 00:00 2026-02-13T02:37:52.564 INFO:teuthology.orchestra.run.trial154.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 17 MB/s | 19 MB 00:01 2026-02-13T02:37:52.613 INFO:teuthology.orchestra.run.trial154.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 519 kB/s | 25 kB 00:00 2026-02-13T02:37:52.663 INFO:teuthology.orchestra.run.trial091.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 209 kB/s | 33 kB 00:00 2026-02-13T02:37:52.801 INFO:teuthology.orchestra.run.trial078.stdout:(12/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 6.8 MB/s | 13 MB 00:01 2026-02-13T02:37:52.872 INFO:teuthology.orchestra.run.trial078.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 3.4 MB/s | 243 kB 00:00 2026-02-13T02:37:52.901 INFO:teuthology.orchestra.run.trial091.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 393 kB/s | 93 kB 00:00 2026-02-13T02:37:52.919 INFO:teuthology.orchestra.run.trial078.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 581 kB/s | 27 kB 00:00 2026-02-13T02:37:52.950 INFO:teuthology.orchestra.run.trial078.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 1.2 MB/s | 37 kB 00:00 2026-02-13T02:37:52.977 INFO:teuthology.orchestra.run.trial078.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 910 kB/s | 24 kB 00:00 2026-02-13T02:37:53.074 INFO:teuthology.orchestra.run.trial078.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 9.2 MB/s | 909 kB 00:00 2026-02-13T02:37:53.097 INFO:teuthology.orchestra.run.trial154.stdout:(12/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 19 MB/s | 13 MB 00:00 2026-02-13T02:37:53.104 INFO:teuthology.orchestra.run.trial078.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 5.2 MB/s | 159 kB 00:00 2026-02-13T02:37:53.132 INFO:teuthology.orchestra.run.trial154.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 7.0 MB/s | 243 kB 00:00 2026-02-13T02:37:53.138 INFO:teuthology.orchestra.run.trial078.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 3.6 MB/s | 123 kB 00:00 2026-02-13T02:37:53.161 INFO:teuthology.orchestra.run.trial154.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 938 kB/s | 27 kB 00:00 2026-02-13T02:37:53.170 INFO:teuthology.orchestra.run.trial078.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 7.5 MB/s | 248 kB 00:00 2026-02-13T02:37:53.192 INFO:teuthology.orchestra.run.trial154.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 1.2 MB/s | 37 kB 00:00 2026-02-13T02:37:53.201 INFO:teuthology.orchestra.run.trial091.stdout:(51/173): libgfortran-11.5.0-14.el9.x86_64.rpm 563 kB/s | 794 kB 00:01 2026-02-13T02:37:53.225 INFO:teuthology.orchestra.run.trial154.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 753 kB/s | 24 kB 00:00 2026-02-13T02:37:53.276 INFO:teuthology.orchestra.run.trial154.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 18 MB/s | 909 kB 00:00 2026-02-13T02:37:53.296 INFO:teuthology.orchestra.run.trial091.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 640 kB/s | 253 kB 00:00 2026-02-13T02:37:53.315 INFO:teuthology.orchestra.run.trial154.stdout:(18/173): ceph-osd-classic-20.3.0-5241.g8f8d382 6.8 MB/s | 16 MB 00:02 2026-02-13T02:37:53.315 INFO:teuthology.orchestra.run.trial154.stdout:(19/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 3.9 MB/s | 159 kB 00:00 2026-02-13T02:37:53.345 INFO:teuthology.orchestra.run.trial154.stdout:(20/173): librados-devel-20.3.0-5241.g8f8d3829. 4.0 MB/s | 123 kB 00:00 2026-02-13T02:37:53.353 INFO:teuthology.orchestra.run.trial154.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 6.5 MB/s | 248 kB 00:00 2026-02-13T02:37:53.387 INFO:teuthology.orchestra.run.trial154.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 1.3 MB/s | 45 kB 00:00 2026-02-13T02:37:53.424 INFO:teuthology.orchestra.run.trial154.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 4.9 MB/s | 185 kB 00:00 2026-02-13T02:37:53.461 INFO:teuthology.orchestra.run.trial154.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 5.3 MB/s | 204 kB 00:00 2026-02-13T02:37:53.501 INFO:teuthology.orchestra.run.trial154.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 7.9 MB/s | 324 kB 00:00 2026-02-13T02:37:53.534 INFO:teuthology.orchestra.run.trial091.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 447 kB/s | 106 kB 00:00 2026-02-13T02:37:53.541 INFO:teuthology.orchestra.run.trial154.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 7.5 MB/s | 306 kB 00:00 2026-02-13T02:37:53.577 INFO:teuthology.orchestra.run.trial154.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 2.7 MB/s | 100 kB 00:00 2026-02-13T02:37:53.613 INFO:teuthology.orchestra.run.trial154.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 2.3 MB/s | 84 kB 00:00 2026-02-13T02:37:53.696 INFO:teuthology.orchestra.run.trial091.stdout:(54/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 733 kB/s | 2.1 MB 00:02 2026-02-13T02:37:53.767 INFO:teuthology.orchestra.run.trial154.stdout:(29/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 19 MB/s | 2.9 MB 00:00 2026-02-13T02:37:53.775 INFO:teuthology.orchestra.run.trial091.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 561 kB/s | 135 kB 00:00 2026-02-13T02:37:53.804 INFO:teuthology.orchestra.run.trial154.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 4.5 MB/s | 172 kB 00:00 2026-02-13T02:37:53.840 INFO:teuthology.orchestra.run.trial154.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.6 MB/s | 57 kB 00:00 2026-02-13T02:37:53.878 INFO:teuthology.orchestra.run.trial154.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 4.7 MB/s | 183 kB 00:00 2026-02-13T02:37:53.921 INFO:teuthology.orchestra.run.trial078.stdout:(21/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 8.6 MB/s | 6.5 MB 00:00 2026-02-13T02:37:53.934 INFO:teuthology.orchestra.run.trial091.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 531 kB/s | 126 kB 00:00 2026-02-13T02:37:53.976 INFO:teuthology.orchestra.run.trial078.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 830 kB/s | 45 kB 00:00 2026-02-13T02:37:54.034 INFO:teuthology.orchestra.run.trial078.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 3.1 MB/s | 185 kB 00:00 2026-02-13T02:37:54.092 INFO:teuthology.orchestra.run.trial078.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 3.4 MB/s | 204 kB 00:00 2026-02-13T02:37:54.154 INFO:teuthology.orchestra.run.trial078.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 5.2 MB/s | 324 kB 00:00 2026-02-13T02:37:54.215 INFO:teuthology.orchestra.run.trial078.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 4.9 MB/s | 306 kB 00:00 2026-02-13T02:37:54.250 INFO:teuthology.orchestra.run.trial091.stdout:(57/173): unzip-6.0-59.el9.x86_64.rpm 575 kB/s | 182 kB 00:00 2026-02-13T02:37:54.251 INFO:teuthology.orchestra.run.trial091.stdout:(58/173): python3-urllib3-1.26.5-7.el9.noarch.r 458 kB/s | 218 kB 00:00 2026-02-13T02:37:54.272 INFO:teuthology.orchestra.run.trial078.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.7 MB/s | 100 kB 00:00 2026-02-13T02:37:54.301 INFO:teuthology.orchestra.run.trial154.stdout:(33/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 6.8 MB/s | 6.5 MB 00:00 2026-02-13T02:37:54.326 INFO:teuthology.orchestra.run.trial078.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.5 MB/s | 84 kB 00:00 2026-02-13T02:37:54.507 INFO:teuthology.orchestra.run.trial154.stdout:(34/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 24 MB/s | 15 MB 00:00 2026-02-13T02:37:54.549 INFO:teuthology.orchestra.run.trial154.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 7.0 MB/s | 297 kB 00:00 2026-02-13T02:37:54.586 INFO:teuthology.orchestra.run.trial154.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.3 MB/s | 50 kB 00:00 2026-02-13T02:37:54.622 INFO:teuthology.orchestra.run.trial154.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 478 kB/s | 17 kB 00:00 2026-02-13T02:37:54.646 INFO:teuthology.orchestra.run.trial091.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 671 kB/s | 266 kB 00:00 2026-02-13T02:37:54.664 INFO:teuthology.orchestra.run.trial154.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 7.0 MB/s | 299 kB 00:00 2026-02-13T02:37:54.721 INFO:teuthology.orchestra.run.trial154.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 18 MB/s | 1.0 MB 00:00 2026-02-13T02:37:54.734 INFO:teuthology.orchestra.run.trial078.stdout:(29/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 7.0 MB/s | 2.9 MB 00:00 2026-02-13T02:37:54.754 INFO:teuthology.orchestra.run.trial154.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 565 kB/s | 18 kB 00:00 2026-02-13T02:37:54.763 INFO:teuthology.orchestra.run.trial091.stdout:(60/173): python3-cryptography-36.0.1-5.el9.x86 817 kB/s | 1.2 MB 00:01 2026-02-13T02:37:54.771 INFO:teuthology.orchestra.run.trial078.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 4.6 MB/s | 172 kB 00:00 2026-02-13T02:37:54.802 INFO:teuthology.orchestra.run.trial078.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.8 MB/s | 57 kB 00:00 2026-02-13T02:37:54.837 INFO:teuthology.orchestra.run.trial078.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 5.3 MB/s | 183 kB 00:00 2026-02-13T02:37:54.893 INFO:teuthology.orchestra.run.trial091.stdout:(61/173): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2026-02-13T02:37:54.980 INFO:teuthology.orchestra.run.trial091.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 910 kB/s | 79 kB 00:00 2026-02-13T02:37:55.087 INFO:teuthology.orchestra.run.trial091.stdout:(63/173): flex-2.6.4-9.el9.x86_64.rpm 2.9 MB/s | 313 kB 00:00 2026-02-13T02:37:55.170 INFO:teuthology.orchestra.run.trial091.stdout:(64/173): flexiblas-3.0.4-8.el9.x86_64.rpm 394 kB/s | 33 kB 00:00 2026-02-13T02:37:55.180 INFO:teuthology.orchestra.run.trial091.stdout:(65/173): boost-program-options-1.75.0-13.el9.x 249 kB/s | 104 kB 00:00 2026-02-13T02:37:55.186 INFO:teuthology.orchestra.run.trial154.stdout:(41/173): ceph-mgr-diskprediction-local-20.3.0- 8.4 MB/s | 7.4 MB 00:00 2026-02-13T02:37:55.270 INFO:teuthology.orchestra.run.trial091.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 202 kB/s | 18 kB 00:00 2026-02-13T02:37:55.321 INFO:teuthology.orchestra.run.trial091.stdout:(67/173): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2026-02-13T02:37:55.357 INFO:teuthology.orchestra.run.trial091.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 128 kB/s | 11 kB 00:00 2026-02-13T02:37:55.411 INFO:teuthology.orchestra.run.trial091.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 1.8 MB/s | 164 kB 00:00 2026-02-13T02:37:55.444 INFO:teuthology.orchestra.run.trial091.stdout:(70/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2026-02-13T02:37:55.494 INFO:teuthology.orchestra.run.trial091.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 549 kB/s | 45 kB 00:00 2026-02-13T02:37:55.526 INFO:teuthology.orchestra.run.trial091.stdout:(72/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 949 kB/s | 160 kB 00:00 2026-02-13T02:37:55.536 INFO:teuthology.orchestra.run.trial091.stdout:(73/173): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2026-02-13T02:37:55.588 INFO:teuthology.orchestra.run.trial091.stdout:(74/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.5 MB/s | 246 kB 00:00 2026-02-13T02:37:55.619 INFO:teuthology.orchestra.run.trial091.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 298 kB/s | 25 kB 00:00 2026-02-13T02:37:55.629 INFO:teuthology.orchestra.run.trial154.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 401 kB/s | 350 kB 00:00 2026-02-13T02:37:55.682 INFO:teuthology.orchestra.run.trial091.stdout:(76/173): libxslt-1.1.34-12.el9.x86_64.rpm 2.4 MB/s | 233 kB 00:00 2026-02-13T02:37:55.701 INFO:teuthology.orchestra.run.trial091.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 619 kB/s | 51 kB 00:00 2026-02-13T02:37:55.755 INFO:teuthology.orchestra.run.trial091.stdout:(78/173): libtool-2.4.6-46.el9.x86_64.rpm 2.5 MB/s | 581 kB 00:00 2026-02-13T02:37:55.780 INFO:teuthology.orchestra.run.trial091.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2026-02-13T02:37:55.786 INFO:teuthology.orchestra.run.trial091.stdout:(80/173): lua-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 188 kB 00:00 2026-02-13T02:37:55.792 INFO:teuthology.orchestra.run.trial154.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 247 kB/s | 40 kB 00:00 2026-02-13T02:37:55.841 INFO:teuthology.orchestra.run.trial091.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 486 kB/s | 42 kB 00:00 2026-02-13T02:37:55.926 INFO:teuthology.orchestra.run.trial091.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 263 kB/s | 22 kB 00:00 2026-02-13T02:37:55.952 INFO:teuthology.orchestra.run.trial154.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 143 kB/s | 23 kB 00:00 2026-02-13T02:37:55.989 INFO:teuthology.orchestra.run.trial091.stdout:(83/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2026-02-13T02:37:56.014 INFO:teuthology.orchestra.run.trial091.stdout:(84/173): perl-threads-2.25-460.el9.x86_64.rpm 661 kB/s | 58 kB 00:00 2026-02-13T02:37:56.072 INFO:teuthology.orchestra.run.trial091.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 541 kB/s | 45 kB 00:00 2026-02-13T02:37:56.084 INFO:teuthology.orchestra.run.trial091.stdout:(86/173): openblas-openmp-0.3.29-1.el9.x86_64.r 17 MB/s | 5.3 MB 00:00 2026-02-13T02:37:56.118 INFO:teuthology.orchestra.run.trial154.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 434 kB/s | 72 kB 00:00 2026-02-13T02:37:56.167 INFO:teuthology.orchestra.run.trial091.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 1.6 MB/s | 138 kB 00:00 2026-02-13T02:37:56.175 INFO:teuthology.orchestra.run.trial091.stdout:(88/173): postgresql-contrib-13.23-1.el9.x86_64 8.6 MB/s | 903 kB 00:00 2026-02-13T02:37:56.221 INFO:teuthology.orchestra.run.trial078.stdout:(33/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 11 MB/s | 15 MB 00:01 2026-02-13T02:37:56.260 INFO:teuthology.orchestra.run.trial091.stdout:(89/173): postgresql-13.23-1.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2026-02-13T02:37:56.264 INFO:teuthology.orchestra.run.trial091.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2026-02-13T02:37:56.307 INFO:teuthology.orchestra.run.trial154.stdout:(46/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 21 MB/s | 78 MB 00:03 2026-02-13T02:37:56.357 INFO:teuthology.orchestra.run.trial091.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 662 kB/s | 61 kB 00:00 2026-02-13T02:37:56.390 INFO:teuthology.orchestra.run.trial091.stdout:(92/173): postgresql-server-13.23-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2026-02-13T02:37:56.441 INFO:teuthology.orchestra.run.trial091.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-02-13T02:37:56.475 INFO:teuthology.orchestra.run.trial091.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 2.9 MB/s | 249 kB 00:00 2026-02-13T02:37:56.525 INFO:teuthology.orchestra.run.trial091.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 571 kB/s | 48 kB 00:00 2026-02-13T02:37:56.546 INFO:teuthology.orchestra.run.trial091.stdout:(96/173): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2026-02-13T02:37:56.560 INFO:teuthology.orchestra.run.trial091.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 2.0 MB/s | 177 kB 00:00 2026-02-13T02:37:56.582 INFO:teuthology.orchestra.run.trial078.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 21 MB/s | 7.4 MB 00:00 2026-02-13T02:37:56.600 INFO:teuthology.orchestra.run.trial078.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 16 MB/s | 297 kB 00:00 2026-02-13T02:37:56.608 INFO:teuthology.orchestra.run.trial091.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 35 kB 00:00 2026-02-13T02:37:56.612 INFO:teuthology.orchestra.run.trial078.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 4.2 MB/s | 50 kB 00:00 2026-02-13T02:37:56.624 INFO:teuthology.orchestra.run.trial078.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 1.4 MB/s | 17 kB 00:00 2026-02-13T02:37:56.639 INFO:teuthology.orchestra.run.trial078.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 20 MB/s | 299 kB 00:00 2026-02-13T02:37:56.645 INFO:teuthology.orchestra.run.trial091.stdout:(99/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 5.1 MB/s | 442 kB 00:00 2026-02-13T02:37:56.679 INFO:teuthology.orchestra.run.trial078.stdout:(39/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 2.8 MB/s | 19 MB 00:06 2026-02-13T02:37:56.691 INFO:teuthology.orchestra.run.trial091.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 925 kB/s | 77 kB 00:00 2026-02-13T02:37:56.695 INFO:teuthology.orchestra.run.trial078.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 1.1 MB/s | 18 kB 00:00 2026-02-13T02:37:56.699 INFO:teuthology.orchestra.run.trial154.stdout:(47/173): libgfortran-11.5.0-14.el9.x86_64.rpm 1.3 MB/s | 794 kB 00:00 2026-02-13T02:37:56.710 INFO:teuthology.orchestra.run.trial078.stdout:(41/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 14 MB/s | 1.0 MB 00:00 2026-02-13T02:37:56.729 INFO:teuthology.orchestra.run.trial091.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 3.1 MB/s | 267 kB 00:00 2026-02-13T02:37:56.747 INFO:teuthology.orchestra.run.trial091.stdout:(102/173): python3-numpy-1.23.5-2.el9.x86_64.rp 30 MB/s | 6.1 MB 00:00 2026-02-13T02:37:56.776 INFO:teuthology.orchestra.run.trial091.stdout:(103/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.8 MB/s | 159 kB 00:00 2026-02-13T02:37:56.814 INFO:teuthology.orchestra.run.trial091.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 3.2 MB/s | 279 kB 00:00 2026-02-13T02:37:56.830 INFO:teuthology.orchestra.run.trial091.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 643 kB/s | 54 kB 00:00 2026-02-13T02:37:56.856 INFO:teuthology.orchestra.run.trial154.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 597 kB/s | 94 kB 00:00 2026-02-13T02:37:56.897 INFO:teuthology.orchestra.run.trial091.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 506 kB/s | 42 kB 00:00 2026-02-13T02:37:56.913 INFO:teuthology.orchestra.run.trial091.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 532 kB/s | 44 kB 00:00 2026-02-13T02:37:56.979 INFO:teuthology.orchestra.run.trial091.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2026-02-13T02:37:56.996 INFO:teuthology.orchestra.run.trial091.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 449 kB/s | 37 kB 00:00 2026-02-13T02:37:57.018 INFO:teuthology.orchestra.run.trial154.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 205 kB/s | 33 kB 00:00 2026-02-13T02:37:57.030 INFO:teuthology.orchestra.run.trial154.stdout:(50/173): libquadmath-11.5.0-14.el9.x86_64.rpm 255 kB/s | 184 kB 00:00 2026-02-13T02:37:57.062 INFO:teuthology.orchestra.run.trial091.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 807 kB/s | 66 kB 00:00 2026-02-13T02:37:57.071 INFO:teuthology.orchestra.run.trial154.stdout:(51/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 1.1 MB/s | 2.1 MB 00:01 2026-02-13T02:37:57.080 INFO:teuthology.orchestra.run.trial091.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 3.5 MB/s | 303 kB 00:00 2026-02-13T02:37:57.156 INFO:teuthology.orchestra.run.trial091.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 615 kB/s | 58 kB 00:00 2026-02-13T02:37:57.163 INFO:teuthology.orchestra.run.trial091.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2026-02-13T02:37:57.184 INFO:teuthology.orchestra.run.trial154.stdout:(52/173): pciutils-3.7.0-7.el9.x86_64.rpm 563 kB/s | 93 kB 00:00 2026-02-13T02:37:57.237 INFO:teuthology.orchestra.run.trial091.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 777 kB/s | 64 kB 00:00 2026-02-13T02:37:57.246 INFO:teuthology.orchestra.run.trial091.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2026-02-13T02:37:57.271 INFO:teuthology.orchestra.run.trial078.stdout:(42/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 14 MB/s | 78 MB 00:05 2026-02-13T02:37:57.277 INFO:teuthology.orchestra.run.trial078.stdout:(43/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 602 kB/s | 350 kB 00:00 2026-02-13T02:37:57.363 INFO:teuthology.orchestra.run.trial078.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 267 kB/s | 23 kB 00:00 2026-02-13T02:37:57.393 INFO:teuthology.orchestra.run.trial091.stdout:(116/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 31 MB/s | 19 MB 00:00 2026-02-13T02:37:57.396 INFO:teuthology.orchestra.run.trial154.stdout:(53/173): python3-cryptography-36.0.1-5.el9.x86 3.8 MB/s | 1.2 MB 00:00 2026-02-13T02:37:57.425 INFO:teuthology.orchestra.run.trial154.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 442 kB/s | 106 kB 00:00 2026-02-13T02:37:57.426 INFO:teuthology.orchestra.run.trial154.stdout:(55/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 640 kB/s | 253 kB 00:00 2026-02-13T02:37:57.459 INFO:teuthology.orchestra.run.trial078.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 753 kB/s | 72 kB 00:00 2026-02-13T02:37:57.563 INFO:teuthology.orchestra.run.trial078.stdout:(46/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 138 kB/s | 40 kB 00:00 2026-02-13T02:37:57.585 INFO:teuthology.orchestra.run.trial154.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 789 kB/s | 126 kB 00:00 2026-02-13T02:37:57.674 INFO:teuthology.orchestra.run.trial154.stdout:(57/173): python3-pycparser-2.20-6.el9.noarch.r 487 kB/s | 135 kB 00:00 2026-02-13T02:37:57.694 INFO:teuthology.orchestra.run.trial078.stdout:(47/173): libgfortran-11.5.0-14.el9.x86_64.rpm 3.3 MB/s | 794 kB 00:00 2026-02-13T02:37:57.724 INFO:teuthology.orchestra.run.trial078.stdout:(48/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.1 MB/s | 2.1 MB 00:01 2026-02-13T02:37:57.745 INFO:teuthology.orchestra.run.trial154.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-13T02:37:57.781 INFO:teuthology.orchestra.run.trial078.stdout:(49/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2026-02-13T02:37:57.794 INFO:teuthology.orchestra.run.trial091.stdout:(117/173): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-13T02:37:57.807 INFO:teuthology.orchestra.run.trial078.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 402 kB/s | 33 kB 00:00 2026-02-13T02:37:57.823 INFO:teuthology.orchestra.run.trial154.stdout:(59/173): python3-urllib3-1.26.5-7.el9.noarch.r 549 kB/s | 218 kB 00:00 2026-02-13T02:37:57.856 INFO:teuthology.orchestra.run.trial078.stdout:(51/173): libquadmath-11.5.0-14.el9.x86_64.rpm 630 kB/s | 184 kB 00:00 2026-02-13T02:37:57.869 INFO:teuthology.orchestra.run.trial078.stdout:(52/173): pciutils-3.7.0-7.el9.x86_64.rpm 1.0 MB/s | 93 kB 00:00 2026-02-13T02:37:57.896 INFO:teuthology.orchestra.run.trial078.stdout:(53/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 253 kB 00:00 2026-02-13T02:37:57.899 INFO:teuthology.orchestra.run.trial091.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.1 MB/s | 551 kB 00:00 2026-02-13T02:37:57.958 INFO:teuthology.orchestra.run.trial078.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-13T02:37:57.982 INFO:teuthology.orchestra.run.trial078.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2026-02-13T02:37:57.987 INFO:teuthology.orchestra.run.trial154.stdout:(60/173): zip-3.0-35.el9.x86_64.rpm 848 kB/s | 266 kB 00:00 2026-02-13T02:37:58.049 INFO:teuthology.orchestra.run.trial078.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 1.4 MB/s | 126 kB 00:00 2026-02-13T02:37:58.070 INFO:teuthology.orchestra.run.trial078.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 2.4 MB/s | 218 kB 00:00 2026-02-13T02:37:58.116 INFO:teuthology.orchestra.run.trial091.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 90 kB/s | 19 kB 00:00 2026-02-13T02:37:58.142 INFO:teuthology.orchestra.run.trial078.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 1.9 MB/s | 182 kB 00:00 2026-02-13T02:37:58.159 INFO:teuthology.orchestra.run.trial078.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 2.9 MB/s | 266 kB 00:00 2026-02-13T02:37:58.164 INFO:teuthology.orchestra.run.trial091.stdout:(120/173): protobuf-compiler-3.14.0-17.el9.x86_ 939 kB/s | 862 kB 00:00 2026-02-13T02:37:58.199 INFO:teuthology.orchestra.run.trial078.stdout:(60/173): python3-cryptography-36.0.1-5.el9.x86 3.6 MB/s | 1.2 MB 00:00 2026-02-13T02:37:58.223 INFO:teuthology.orchestra.run.trial091.stdout:(121/173): gperftools-libs-2.9.1-3.el9.x86_64.r 716 kB/s | 308 kB 00:00 2026-02-13T02:37:58.263 INFO:teuthology.orchestra.run.trial078.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 1.6 MB/s | 104 kB 00:00 2026-02-13T02:37:58.270 INFO:teuthology.orchestra.run.trial078.stdout:(62/173): automake-1.16.2-8.el9.noarch.rpm 5.3 MB/s | 689 kB 00:00 2026-02-13T02:37:58.285 INFO:teuthology.orchestra.run.trial078.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 3.4 MB/s | 79 kB 00:00 2026-02-13T02:37:58.289 INFO:teuthology.orchestra.run.trial078.stdout:(64/173): bison-3.7.4-5.el9.x86_64.rpm 7.1 MB/s | 943 kB 00:00 2026-02-13T02:37:58.295 INFO:teuthology.orchestra.run.trial078.stdout:(65/173): flex-2.6.4-9.el9.x86_64.rpm 12 MB/s | 313 kB 00:00 2026-02-13T02:37:58.308 INFO:teuthology.orchestra.run.trial078.stdout:(66/173): flexiblas-3.0.4-8.el9.x86_64.rpm 1.5 MB/s | 33 kB 00:00 2026-02-13T02:37:58.316 INFO:teuthology.orchestra.run.trial078.stdout:(67/173): flexiblas-openblas-openmp-3.0.4-8.el9 839 kB/s | 18 kB 00:00 2026-02-13T02:37:58.329 INFO:teuthology.orchestra.run.trial078.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 515 kB/s | 11 kB 00:00 2026-02-13T02:37:58.340 INFO:teuthology.orchestra.run.trial078.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 6.9 MB/s | 164 kB 00:00 2026-02-13T02:37:58.353 INFO:teuthology.orchestra.run.trial078.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.6 MB/s | 160 kB 00:00 2026-02-13T02:37:58.362 INFO:teuthology.orchestra.run.trial078.stdout:(71/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 41 MB/s | 3.0 MB 00:00 2026-02-13T02:37:58.363 INFO:teuthology.orchestra.run.trial078.stdout:(72/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-13T02:37:58.374 INFO:teuthology.orchestra.run.trial091.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 118 kB/s | 25 kB 00:00 2026-02-13T02:37:58.382 INFO:teuthology.orchestra.run.trial154.stdout:(61/173): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2026-02-13T02:37:58.387 INFO:teuthology.orchestra.run.trial078.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 9.9 MB/s | 246 kB 00:00 2026-02-13T02:37:58.389 INFO:teuthology.orchestra.run.trial078.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 21 MB/s | 581 kB 00:00 2026-02-13T02:37:58.405 INFO:teuthology.orchestra.run.trial154.stdout:(62/173): boost-program-options-1.75.0-13.el9.x 249 kB/s | 104 kB 00:00 2026-02-13T02:37:58.408 INFO:teuthology.orchestra.run.trial078.stdout:(75/173): librdkafka-1.6.1-102.el9.x86_64.rpm 12 MB/s | 662 kB 00:00 2026-02-13T02:37:58.409 INFO:teuthology.orchestra.run.trial078.stdout:(76/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 1.1 MB/s | 25 kB 00:00 2026-02-13T02:37:58.415 INFO:teuthology.orchestra.run.trial078.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 8.9 MB/s | 233 kB 00:00 2026-02-13T02:37:58.430 INFO:teuthology.orchestra.run.trial078.stdout:(78/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 2.2 MB/s | 51 kB 00:00 2026-02-13T02:37:58.433 INFO:teuthology.orchestra.run.trial078.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-13T02:37:58.439 INFO:teuthology.orchestra.run.trial078.stdout:(80/173): lua-5.4.4-4.el9.x86_64.rpm 7.7 MB/s | 188 kB 00:00 2026-02-13T02:37:58.453 INFO:teuthology.orchestra.run.trial078.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-13T02:37:58.469 INFO:teuthology.orchestra.run.trial154.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 918 kB/s | 79 kB 00:00 2026-02-13T02:37:58.475 INFO:teuthology.orchestra.run.trial078.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-13T02:37:58.492 INFO:teuthology.orchestra.run.trial078.stdout:(83/173): openblas-openmp-0.3.29-1.el9.x86_64.r 90 MB/s | 5.3 MB 00:00 2026-02-13T02:37:58.496 INFO:teuthology.orchestra.run.trial154.stdout:(64/173): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2026-02-13T02:37:58.497 INFO:teuthology.orchestra.run.trial078.stdout:(84/173): perl-threads-2.25-460.el9.x86_64.rpm 2.6 MB/s | 58 kB 00:00 2026-02-13T02:37:58.500 INFO:teuthology.orchestra.run.trial091.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 177 kB/s | 49 kB 00:00 2026-02-13T02:37:58.514 INFO:teuthology.orchestra.run.trial078.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 2.0 MB/s | 45 kB 00:00 2026-02-13T02:37:58.542 INFO:teuthology.orchestra.run.trial078.stdout:(86/173): postgresql-contrib-13.23-1.el9.x86_64 32 MB/s | 903 kB 00:00 2026-02-13T02:37:58.547 INFO:teuthology.orchestra.run.trial078.stdout:(87/173): postgresql-13.23-1.el9.x86_64.rpm 32 MB/s | 1.6 MB 00:00 2026-02-13T02:37:58.551 INFO:teuthology.orchestra.run.trial154.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 397 kB/s | 33 kB 00:00 2026-02-13T02:37:58.572 INFO:teuthology.orchestra.run.trial078.stdout:(88/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2026-02-13T02:37:58.574 INFO:teuthology.orchestra.run.trial078.stdout:(89/173): postgresql-private-libs-13.23-1.el9.x 4.2 MB/s | 138 kB 00:00 2026-02-13T02:37:58.603 INFO:teuthology.orchestra.run.trial078.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 33 MB/s | 1.0 MB 00:00 2026-02-13T02:37:58.632 INFO:teuthology.orchestra.run.trial154.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 224 kB/s | 18 kB 00:00 2026-02-13T02:37:58.633 INFO:teuthology.orchestra.run.trial078.stdout:(91/173): postgresql-server-13.23-1.el9.x86_64. 68 MB/s | 5.8 MB 00:00 2026-02-13T02:37:58.634 INFO:teuthology.orchestra.run.trial078.stdout:(92/173): python3-colorama-0.4.6-3.el9.noarch.r 1.9 MB/s | 61 kB 00:00 2026-02-13T02:37:58.654 INFO:teuthology.orchestra.run.trial091.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 241 kB/s | 67 kB 00:00 2026-02-13T02:37:58.657 INFO:teuthology.orchestra.run.trial154.stdout:(67/173): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2026-02-13T02:37:58.664 INFO:teuthology.orchestra.run.trial078.stdout:(93/173): python3-babel-2.9.1-2.el9.noarch.rpm 67 MB/s | 6.0 MB 00:00 2026-02-13T02:37:58.665 INFO:teuthology.orchestra.run.trial078.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 7.7 MB/s | 249 kB 00:00 2026-02-13T02:37:58.690 INFO:teuthology.orchestra.run.trial078.stdout:(95/173): python3-libstoragemgmt-1.10.1-1.el9.x 7.1 MB/s | 177 kB 00:00 2026-02-13T02:37:58.713 INFO:teuthology.orchestra.run.trial078.stdout:(96/173): python3-markupsafe-1.1.1-12.el9.x86_6 1.5 MB/s | 35 kB 00:00 2026-02-13T02:37:58.714 INFO:teuthology.orchestra.run.trial154.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 137 kB/s | 11 kB 00:00 2026-02-13T02:37:58.759 INFO:teuthology.orchestra.run.trial154.stdout:(69/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2026-02-13T02:37:58.763 INFO:teuthology.orchestra.run.trial154.stdout:(70/173): libnbd-1.20.3-4.el9.x86_64.rpm 1.5 MB/s | 164 kB 00:00 2026-02-13T02:37:58.768 INFO:teuthology.orchestra.run.trial078.stdout:(97/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 112 MB/s | 6.1 MB 00:00 2026-02-13T02:37:58.768 INFO:teuthology.orchestra.run.trial078.stdout:(98/173): python3-jmespath-1.0.1-1.el9.noarch.r 455 kB/s | 48 kB 00:00 2026-02-13T02:37:58.780 INFO:teuthology.orchestra.run.trial078.stdout:(99/173): python3-devel-3.9.25-2.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2026-02-13T02:37:58.794 INFO:teuthology.orchestra.run.trial078.stdout:(100/173): python3-numpy-f2py-1.23.5-2.el9.x86_ 16 MB/s | 442 kB 00:00 2026-02-13T02:37:58.806 INFO:teuthology.orchestra.run.trial154.stdout:(71/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2026-02-13T02:37:58.812 INFO:teuthology.orchestra.run.trial078.stdout:(101/173): python3-packaging-20.9-5.el9.noarch. 1.7 MB/s | 77 kB 00:00 2026-02-13T02:37:58.818 INFO:teuthology.orchestra.run.trial091.stdout:(125/173): libarrow-9.0.0-15.el9.x86_64.rpm 6.3 MB/s | 4.4 MB 00:00 2026-02-13T02:37:58.819 INFO:teuthology.orchestra.run.trial078.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 6.3 MB/s | 159 kB 00:00 2026-02-13T02:37:58.826 INFO:teuthology.orchestra.run.trial078.stdout:(103/173): python3-protobuf-3.14.0-17.el9.noarc 5.8 MB/s | 267 kB 00:00 2026-02-13T02:37:58.841 INFO:teuthology.orchestra.run.trial154.stdout:(72/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 554 kB/s | 45 kB 00:00 2026-02-13T02:37:58.842 INFO:teuthology.orchestra.run.trial078.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 2.3 MB/s | 54 kB 00:00 2026-02-13T02:37:58.856 INFO:teuthology.orchestra.run.trial078.stdout:(105/173): python3-pyasn1-modules-0.4.8-6.el9.n 6.3 MB/s | 279 kB 00:00 2026-02-13T02:37:58.857 INFO:teuthology.orchestra.run.trial091.stdout:(126/173): luarocks-3.9.2-5.el9.noarch.rpm 424 kB/s | 151 kB 00:00 2026-02-13T02:37:58.865 INFO:teuthology.orchestra.run.trial078.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-13T02:37:58.878 INFO:teuthology.orchestra.run.trial078.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.9 MB/s | 44 kB 00:00 2026-02-13T02:37:58.888 INFO:teuthology.orchestra.run.trial078.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-13T02:37:58.900 INFO:teuthology.orchestra.run.trial078.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 1.7 MB/s | 37 kB 00:00 2026-02-13T02:37:58.906 INFO:teuthology.orchestra.run.trial154.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 2.4 MB/s | 246 kB 00:00 2026-02-13T02:37:58.911 INFO:teuthology.orchestra.run.trial078.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-13T02:37:58.926 INFO:teuthology.orchestra.run.trial078.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-13T02:37:58.931 INFO:teuthology.orchestra.run.trial154.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 6.3 MB/s | 581 kB 00:00 2026-02-13T02:37:58.933 INFO:teuthology.orchestra.run.trial078.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 2.5 MB/s | 58 kB 00:00 2026-02-13T02:37:58.949 INFO:teuthology.orchestra.run.trial154.stdout:(75/173): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2026-02-13T02:37:58.949 INFO:teuthology.orchestra.run.trial078.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 4.1 MB/s | 96 kB 00:00 2026-02-13T02:37:58.955 INFO:teuthology.orchestra.run.trial078.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-13T02:37:58.971 INFO:teuthology.orchestra.run.trial078.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-13T02:37:58.989 INFO:teuthology.orchestra.run.trial154.stdout:(76/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 298 kB/s | 25 kB 00:00 2026-02-13T02:37:59.015 INFO:teuthology.orchestra.run.trial154.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 2.7 MB/s | 233 kB 00:00 2026-02-13T02:37:59.022 INFO:teuthology.orchestra.run.trial078.stdout:(116/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 98 MB/s | 19 MB 00:00 2026-02-13T02:37:59.023 INFO:teuthology.orchestra.run.trial078.stdout:(117/173): lua-devel-5.4.4-4.el9.x86_64.rpm 331 kB/s | 22 kB 00:00 2026-02-13T02:37:59.033 INFO:teuthology.orchestra.run.trial154.stdout:(78/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 607 kB/s | 51 kB 00:00 2026-02-13T02:37:59.056 INFO:teuthology.orchestra.run.trial078.stdout:(118/173): protobuf-compiler-3.14.0-17.el9.x86_ 9.9 MB/s | 862 kB 00:00 2026-02-13T02:37:59.073 INFO:teuthology.orchestra.run.trial091.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 137 kB/s | 29 kB 00:00 2026-02-13T02:37:59.093 INFO:teuthology.orchestra.run.trial154.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 292 kB 00:00 2026-02-13T02:37:59.099 INFO:teuthology.orchestra.run.trial154.stdout:(80/173): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2026-02-13T02:37:59.116 INFO:teuthology.orchestra.run.trial154.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 507 kB/s | 42 kB 00:00 2026-02-13T02:37:59.146 INFO:teuthology.orchestra.run.trial091.stdout:(128/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.7 MB/s | 838 kB 00:00 2026-02-13T02:37:59.198 INFO:teuthology.orchestra.run.trial154.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 270 kB/s | 22 kB 00:00 2026-02-13T02:37:59.282 INFO:teuthology.orchestra.run.trial154.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 694 kB/s | 58 kB 00:00 2026-02-13T02:37:59.299 INFO:teuthology.orchestra.run.trial154.stdout:(84/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2026-02-13T02:37:59.314 INFO:teuthology.orchestra.run.trial078.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2026-02-13T02:37:59.319 INFO:teuthology.orchestra.run.trial091.stdout:(129/173): python3-asyncssh-2.13.2-5.el9.noarch 1.1 MB/s | 548 kB 00:00 2026-02-13T02:37:59.351 INFO:teuthology.orchestra.run.trial091.stdout:(130/173): python3-backports-tarfile-1.2.0-1.el 216 kB/s | 60 kB 00:00 2026-02-13T02:37:59.357 INFO:teuthology.orchestra.run.trial091.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 206 kB/s | 43 kB 00:00 2026-02-13T02:37:59.365 INFO:teuthology.orchestra.run.trial154.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 536 kB/s | 45 kB 00:00 2026-02-13T02:37:59.413 INFO:teuthology.orchestra.run.trial154.stdout:(86/173): postgresql-13.23-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2026-02-13T02:37:59.436 INFO:teuthology.orchestra.run.trial154.stdout:(87/173): openblas-openmp-0.3.29-1.el9.x86_64.r 15 MB/s | 5.3 MB 00:00 2026-02-13T02:37:59.496 INFO:teuthology.orchestra.run.trial154.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 1.6 MB/s | 138 kB 00:00 2026-02-13T02:37:59.497 INFO:teuthology.orchestra.run.trial091.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 97 kB/s | 14 kB 00:00 2026-02-13T02:37:59.497 INFO:teuthology.orchestra.run.trial154.stdout:(89/173): postgresql-contrib-13.23-1.el9.x86_64 6.7 MB/s | 903 kB 00:00 2026-02-13T02:37:59.535 INFO:teuthology.orchestra.run.trial091.stdout:(133/173): python3-cachetools-4.2.4-1.el9.noarc 149 kB/s | 32 kB 00:00 2026-02-13T02:37:59.539 INFO:teuthology.orchestra.run.trial078.stdout:(120/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.0 MB/s | 551 kB 00:00 2026-02-13T02:37:59.586 INFO:teuthology.orchestra.run.trial154.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2026-02-13T02:37:59.622 INFO:teuthology.orchestra.run.trial078.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 297 kB/s | 25 kB 00:00 2026-02-13T02:37:59.625 INFO:teuthology.orchestra.run.trial078.stdout:(122/173): gperftools-libs-2.9.1-3.el9.x86_64.r 511 kB/s | 308 kB 00:00 2026-02-13T02:37:59.635 INFO:teuthology.orchestra.run.trial154.stdout:(91/173): postgresql-server-13.23-1.el9.x86_64. 29 MB/s | 5.8 MB 00:00 2026-02-13T02:37:59.668 INFO:teuthology.orchestra.run.trial154.stdout:(92/173): python3-colorama-0.4.6-3.el9.noarch.r 740 kB/s | 61 kB 00:00 2026-02-13T02:37:59.692 INFO:teuthology.orchestra.run.trial078.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 707 kB/s | 49 kB 00:00 2026-02-13T02:37:59.716 INFO:teuthology.orchestra.run.trial091.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 484 kB/s | 173 kB 00:00 2026-02-13T02:37:59.719 INFO:teuthology.orchestra.run.trial154.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 2.8 MB/s | 244 kB 00:00 2026-02-13T02:37:59.720 INFO:teuthology.orchestra.run.trial078.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 714 kB/s | 67 kB 00:00 2026-02-13T02:37:59.752 INFO:teuthology.orchestra.run.trial154.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 2.9 MB/s | 249 kB 00:00 2026-02-13T02:37:59.798 INFO:teuthology.orchestra.run.trial078.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2026-02-13T02:37:59.802 INFO:teuthology.orchestra.run.trial154.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 577 kB/s | 48 kB 00:00 2026-02-13T02:37:59.819 INFO:teuthology.orchestra.run.trial154.stdout:(96/173): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2026-02-13T02:37:59.836 INFO:teuthology.orchestra.run.trial154.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 2.1 MB/s | 177 kB 00:00 2026-02-13T02:37:59.850 INFO:teuthology.orchestra.run.trial078.stdout:(126/173): libarrow-9.0.0-15.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2026-02-13T02:37:59.884 INFO:teuthology.orchestra.run.trial154.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 424 kB/s | 35 kB 00:00 2026-02-13T02:37:59.911 INFO:teuthology.orchestra.run.trial078.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 481 kB/s | 29 kB 00:00 2026-02-13T02:37:59.921 INFO:teuthology.orchestra.run.trial154.stdout:(99/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 5.1 MB/s | 442 kB 00:00 2026-02-13T02:37:59.922 INFO:teuthology.orchestra.run.trial078.stdout:(128/173): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2026-02-13T02:37:59.926 INFO:teuthology.orchestra.run.trial091.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 834 kB/s | 358 kB 00:00 2026-02-13T02:37:59.964 INFO:teuthology.orchestra.run.trial091.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 707 kB/s | 303 kB 00:00 2026-02-13T02:37:59.966 INFO:teuthology.orchestra.run.trial154.stdout:(100/173): python3-packaging-20.9-5.el9.noarch. 935 kB/s | 77 kB 00:00 2026-02-13T02:37:59.973 INFO:teuthology.orchestra.run.trial078.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 976 kB/s | 60 kB 00:00 2026-02-13T02:37:59.985 INFO:teuthology.orchestra.run.trial078.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 685 kB/s | 43 kB 00:00 2026-02-13T02:38:00.003 INFO:teuthology.orchestra.run.trial078.stdout:(131/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2026-02-13T02:38:00.005 INFO:teuthology.orchestra.run.trial154.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 3.1 MB/s | 267 kB 00:00 2026-02-13T02:38:00.028 INFO:teuthology.orchestra.run.trial154.stdout:(102/173): python3-numpy-1.23.5-2.el9.x86_64.rp 29 MB/s | 6.1 MB 00:00 2026-02-13T02:38:00.048 INFO:teuthology.orchestra.run.trial078.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 426 kB/s | 32 kB 00:00 2026-02-13T02:38:00.051 INFO:teuthology.orchestra.run.trial154.stdout:(103/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.8 MB/s | 159 kB 00:00 2026-02-13T02:38:00.054 INFO:teuthology.orchestra.run.trial078.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 206 kB/s | 14 kB 00:00 2026-02-13T02:38:00.090 INFO:teuthology.orchestra.run.trial154.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 3.2 MB/s | 279 kB 00:00 2026-02-13T02:38:00.094 INFO:teuthology.orchestra.run.trial078.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 1.9 MB/s | 173 kB 00:00 2026-02-13T02:38:00.113 INFO:teuthology.orchestra.run.trial154.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 626 kB/s | 54 kB 00:00 2026-02-13T02:38:00.114 INFO:teuthology.orchestra.run.trial078.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 5.4 MB/s | 358 kB 00:00 2026-02-13T02:38:00.136 INFO:teuthology.orchestra.run.trial091.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 605 kB/s | 254 kB 00:00 2026-02-13T02:38:00.142 INFO:teuthology.orchestra.run.trial078.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.3 MB/s | 303 kB 00:00 2026-02-13T02:38:00.172 INFO:teuthology.orchestra.run.trial154.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 506 kB/s | 42 kB 00:00 2026-02-13T02:38:00.199 INFO:teuthology.orchestra.run.trial154.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 513 kB/s | 44 kB 00:00 2026-02-13T02:38:00.201 INFO:teuthology.orchestra.run.trial078.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 2.3 MB/s | 254 kB 00:00 2026-02-13T02:38:00.210 INFO:teuthology.orchestra.run.trial078.stdout:(138/173): python3-grpcio-1.46.7-10.el9.x86_64. 21 MB/s | 2.0 MB 00:00 2026-02-13T02:38:00.216 INFO:teuthology.orchestra.run.trial078.stdout:(139/173): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2026-02-13T02:38:00.255 INFO:teuthology.orchestra.run.trial154.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2026-02-13T02:38:00.280 INFO:teuthology.orchestra.run.trial078.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 253 kB/s | 18 kB 00:00 2026-02-13T02:38:00.281 INFO:teuthology.orchestra.run.trial078.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 358 kB/s | 23 kB 00:00 2026-02-13T02:38:00.281 INFO:teuthology.orchestra.run.trial091.stdout:(138/173): python3-jaraco-8.2.1-3.el9.noarch.rp 74 kB/s | 11 kB 00:00 2026-02-13T02:38:00.284 INFO:teuthology.orchestra.run.trial154.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 436 kB/s | 37 kB 00:00 2026-02-13T02:38:00.298 INFO:teuthology.orchestra.run.trial078.stdout:(142/173): python3-jaraco-8.2.1-3.el9.noarch.rp 109 kB/s | 11 kB 00:00 2026-02-13T02:38:00.317 INFO:teuthology.orchestra.run.trial091.stdout:(139/173): python3-grpcio-tools-1.46.7-10.el9.x 408 kB/s | 144 kB 00:00 2026-02-13T02:38:00.338 INFO:teuthology.orchestra.run.trial154.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 793 kB/s | 66 kB 00:00 2026-02-13T02:38:00.342 INFO:teuthology.orchestra.run.trial078.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 316 kB/s | 19 kB 00:00 2026-02-13T02:38:00.343 INFO:teuthology.orchestra.run.trial078.stdout:(144/173): python3-jaraco-context-6.0.1-3.el9.n 313 kB/s | 20 kB 00:00 2026-02-13T02:38:00.370 INFO:teuthology.orchestra.run.trial154.stdout:(111/173): socat-1.7.4.1-8.el9.x86_64.rpm 3.5 MB/s | 303 kB 00:00 2026-02-13T02:38:00.382 INFO:teuthology.orchestra.run.trial078.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 317 kB/s | 26 kB 00:00 2026-02-13T02:38:00.423 INFO:teuthology.orchestra.run.trial154.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 686 kB/s | 58 kB 00:00 2026-02-13T02:38:00.426 INFO:teuthology.orchestra.run.trial078.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 948 kB/s | 79 kB 00:00 2026-02-13T02:38:00.453 INFO:teuthology.orchestra.run.trial154.stdout:(113/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2026-02-13T02:38:00.466 INFO:teuthology.orchestra.run.trial078.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2026-02-13T02:38:00.490 INFO:teuthology.orchestra.run.trial078.stdout:(148/173): python3-kubernetes-26.1.0-3.el9.noar 6.9 MB/s | 1.0 MB 00:00 2026-02-13T02:38:00.491 INFO:teuthology.orchestra.run.trial078.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 254 kB/s | 16 kB 00:00 2026-02-13T02:38:00.491 INFO:teuthology.orchestra.run.trial091.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 84 kB/s | 18 kB 00:00 2026-02-13T02:38:00.506 INFO:teuthology.orchestra.run.trial154.stdout:(114/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 764 kB/s | 64 kB 00:00 2026-02-13T02:38:00.518 INFO:teuthology.orchestra.run.trial154.stdout:(115/173): lua-devel-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 22 kB 00:00 2026-02-13T02:38:00.527 INFO:teuthology.orchestra.run.trial091.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 110 kB/s | 23 kB 00:00 2026-02-13T02:38:00.535 INFO:teuthology.orchestra.run.trial154.stdout:(116/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 543 kB/s | 45 kB 00:00 2026-02-13T02:38:00.538 INFO:teuthology.orchestra.run.trial154.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 42 MB/s | 862 kB 00:00 2026-02-13T02:38:00.551 INFO:teuthology.orchestra.run.trial078.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2026-02-13T02:38:00.563 INFO:teuthology.orchestra.run.trial078.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 389 kB/s | 28 kB 00:00 2026-02-13T02:38:00.569 INFO:teuthology.orchestra.run.trial078.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 392 kB/s | 31 kB 00:00 2026-02-13T02:38:00.580 INFO:teuthology.orchestra.run.trial091.stdout:(142/173): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2026-02-13T02:38:00.643 INFO:teuthology.orchestra.run.trial078.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 734 kB/s | 59 kB 00:00 2026-02-13T02:38:00.645 INFO:teuthology.orchestra.run.trial078.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2026-02-13T02:38:00.661 INFO:teuthology.orchestra.run.trial154.stdout:(118/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 32 MB/s | 19 MB 00:00 2026-02-13T02:38:00.667 INFO:teuthology.orchestra.run.trial078.stdout:(155/173): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2026-02-13T02:38:00.700 INFO:teuthology.orchestra.run.trial091.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 94 kB/s | 20 kB 00:00 2026-02-13T02:38:00.715 INFO:teuthology.orchestra.run.trial078.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 1.2 MB/s | 86 kB 00:00 2026-02-13T02:38:00.733 INFO:teuthology.orchestra.run.trial078.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2026-02-13T02:38:00.736 INFO:teuthology.orchestra.run.trial091.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 93 kB/s | 19 kB 00:00 2026-02-13T02:38:00.747 INFO:teuthology.orchestra.run.trial154.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 228 kB/s | 19 kB 00:00 2026-02-13T02:38:00.776 INFO:teuthology.orchestra.run.trial154.stdout:(120/173): gperftools-libs-2.9.1-3.el9.x86_64.r 1.3 MB/s | 308 kB 00:00 2026-02-13T02:38:00.777 INFO:teuthology.orchestra.run.trial078.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 325 kB/s | 20 kB 00:00 2026-02-13T02:38:00.796 INFO:teuthology.orchestra.run.trial078.stdout:(159/173): python3-xmltodict-0.12.0-15.el9.noar 171 kB/s | 22 kB 00:00 2026-02-13T02:38:00.798 INFO:teuthology.orchestra.run.trial091.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 121 kB/s | 26 kB 00:00 2026-02-13T02:38:00.802 INFO:teuthology.orchestra.run.trial078.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-13T02:38:00.808 INFO:teuthology.orchestra.run.trial154.stdout:(121/173): abseil-cpp-20211102.0-4.el9.x86_64.r 2.0 MB/s | 551 kB 00:00 2026-02-13T02:38:00.837 INFO:teuthology.orchestra.run.trial154.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 407 kB/s | 25 kB 00:00 2026-02-13T02:38:00.889 INFO:teuthology.orchestra.run.trial078.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2026-02-13T02:38:00.910 INFO:teuthology.orchestra.run.trial078.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.0 MB/s | 122 kB 00:00 2026-02-13T02:38:00.946 INFO:teuthology.orchestra.run.trial078.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 24 MB/s | 3.5 MB 00:00 2026-02-13T02:38:01.023 INFO:teuthology.orchestra.run.trial091.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 275 kB/s | 79 kB 00:00 2026-02-13T02:38:01.027 INFO:teuthology.orchestra.run.trial154.stdout:(123/173): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-13T02:38:01.028 INFO:teuthology.orchestra.run.trial154.stdout:(124/173): liboath-2.6.12-1.el9.x86_64.rpm 222 kB/s | 49 kB 00:00 2026-02-13T02:38:01.033 INFO:teuthology.orchestra.run.trial154.stdout:(125/173): libunwind-1.6.2-1.el9.x86_64.rpm 343 kB/s | 67 kB 00:00 2026-02-13T02:38:01.037 INFO:teuthology.orchestra.run.trial078.stdout:(164/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 19 MB/s | 2.8 MB 00:00 2026-02-13T02:38:01.061 INFO:teuthology.orchestra.run.trial154.stdout:(126/173): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2026-02-13T02:38:01.066 INFO:teuthology.orchestra.run.trial078.stdout:(165/173): NetworkManager-1.54.3-2.el9.x86_64.r 15 MB/s | 2.4 MB 00:00 2026-02-13T02:38:01.075 INFO:teuthology.orchestra.run.trial091.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 208 kB/s | 58 kB 00:00 2026-02-13T02:38:01.078 INFO:teuthology.orchestra.run.trial154.stdout:(127/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 16 MB/s | 838 kB 00:00 2026-02-13T02:38:01.089 INFO:teuthology.orchestra.run.trial154.stdout:(128/173): python3-asyncssh-2.13.2-5.el9.noarch 9.6 MB/s | 548 kB 00:00 2026-02-13T02:38:01.093 INFO:teuthology.orchestra.run.trial154.stdout:(129/173): python3-autocommand-2.2.2-8.el9.noar 948 kB/s | 29 kB 00:00 2026-02-13T02:38:01.113 INFO:teuthology.orchestra.run.trial154.stdout:(130/173): python3-backports-tarfile-1.2.0-1.el 1.7 MB/s | 60 kB 00:00 2026-02-13T02:38:01.123 INFO:teuthology.orchestra.run.trial154.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2026-02-13T02:38:01.125 INFO:teuthology.orchestra.run.trial154.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 986 kB/s | 32 kB 00:00 2026-02-13T02:38:01.134 INFO:teuthology.orchestra.run.trial078.stdout:(166/173): NetworkManager-libnm-1.54.3-2.el9.x8 10 MB/s | 1.9 MB 00:00 2026-02-13T02:38:01.145 INFO:teuthology.orchestra.run.trial154.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 450 kB/s | 14 kB 00:00 2026-02-13T02:38:01.154 INFO:teuthology.orchestra.run.trial078.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 2.8 MB/s | 248 kB 00:00 2026-02-13T02:38:01.165 INFO:teuthology.orchestra.run.trial154.stdout:(134/173): python3-cheroot-10.0.1-4.el9.noarch. 4.1 MB/s | 173 kB 00:00 2026-02-13T02:38:01.186 INFO:teuthology.orchestra.run.trial154.stdout:(135/173): python3-cherrypy-18.6.1-2.el9.noarch 5.8 MB/s | 358 kB 00:00 2026-02-13T02:38:01.231 INFO:teuthology.orchestra.run.trial154.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.4 MB/s | 303 kB 00:00 2026-02-13T02:38:01.234 INFO:teuthology.orchestra.run.trial091.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 78 kB/s | 16 kB 00:00 2026-02-13T02:38:01.234 INFO:teuthology.orchestra.run.trial078.stdout:(168/173): iproute-6.17.0-2.el9.x86_64.rpm 8.5 MB/s | 866 kB 00:00 2026-02-13T02:38:01.244 INFO:teuthology.orchestra.run.trial154.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 3.1 MB/s | 254 kB 00:00 2026-02-13T02:38:01.245 INFO:teuthology.orchestra.run.trial078.stdout:(169/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 4.8 MB/s | 454 kB 00:00 2026-02-13T02:38:01.261 INFO:teuthology.orchestra.run.trial091.stdout:(149/173): python3-kubernetes-26.1.0-3.el9.noar 1.8 MB/s | 1.0 MB 00:00 2026-02-13T02:38:01.323 INFO:teuthology.orchestra.run.trial078.stdout:(170/173): NetworkManager-team-1.54.3-2.el9.x86 129 kB/s | 37 kB 00:00 2026-02-13T02:38:01.346 INFO:teuthology.orchestra.run.trial078.stdout:(171/173): openssl-fips-provider-3.5.5-1.el9.x8 7.9 MB/s | 814 kB 00:00 2026-02-13T02:38:01.349 INFO:teuthology.orchestra.run.trial154.stdout:(138/173): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2026-02-13T02:38:01.349 INFO:teuthology.orchestra.run.trial078.stdout:(172/173): openssl-3.5.5-1.el9.x86_64.rpm 13 MB/s | 1.5 MB 00:00 2026-02-13T02:38:01.354 INFO:teuthology.orchestra.run.trial154.stdout:(139/173): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2026-02-13T02:38:01.355 INFO:teuthology.orchestra.run.trial154.stdout:(140/173): python3-jaraco-8.2.1-3.el9.noarch.rp 96 kB/s | 11 kB 00:00 2026-02-13T02:38:01.362 INFO:teuthology.orchestra.run.trial091.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 314 kB/s | 90 kB 00:00 2026-02-13T02:38:01.380 INFO:teuthology.orchestra.run.trial154.stdout:(141/173): python3-jaraco-classes-3.2.1-5.el9.n 564 kB/s | 18 kB 00:00 2026-02-13T02:38:01.386 INFO:teuthology.orchestra.run.trial154.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 730 kB/s | 23 kB 00:00 2026-02-13T02:38:01.388 INFO:teuthology.orchestra.run.trial154.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 602 kB/s | 20 kB 00:00 2026-02-13T02:38:01.413 INFO:teuthology.orchestra.run.trial154.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 606 kB/s | 19 kB 00:00 2026-02-13T02:38:01.419 INFO:teuthology.orchestra.run.trial154.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 812 kB/s | 26 kB 00:00 2026-02-13T02:38:01.452 INFO:teuthology.orchestra.run.trial091.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 130 kB/s | 28 kB 00:00 2026-02-13T02:38:01.476 INFO:teuthology.orchestra.run.trial154.stdout:(146/173): python3-kubernetes-26.1.0-3.el9.noar 12 MB/s | 1.0 MB 00:00 2026-02-13T02:38:01.476 INFO:teuthology.orchestra.run.trial091.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 143 kB/s | 31 kB 00:00 2026-02-13T02:38:01.479 INFO:teuthology.orchestra.run.trial154.stdout:(147/173): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2026-02-13T02:38:01.483 INFO:teuthology.orchestra.run.trial154.stdout:(148/173): python3-natsort-7.1.1-5.el9.noarch.r 908 kB/s | 58 kB 00:00 2026-02-13T02:38:01.507 INFO:teuthology.orchestra.run.trial154.stdout:(149/173): python3-portend-3.1.0-2.el9.noarch.r 521 kB/s | 16 kB 00:00 2026-02-13T02:38:01.514 INFO:teuthology.orchestra.run.trial154.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.5 MB/s | 90 kB 00:00 2026-02-13T02:38:01.544 INFO:teuthology.orchestra.run.trial154.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 459 kB/s | 28 kB 00:00 2026-02-13T02:38:01.546 INFO:teuthology.orchestra.run.trial154.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 786 kB/s | 31 kB 00:00 2026-02-13T02:38:01.557 INFO:teuthology.orchestra.run.trial154.stdout:(153/173): python3-routes-2.5.1-5.el9.noarch.rp 4.3 MB/s | 188 kB 00:00 2026-02-13T02:38:01.578 INFO:teuthology.orchestra.run.trial154.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-13T02:38:01.579 INFO:teuthology.orchestra.run.trial154.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2026-02-13T02:38:01.592 INFO:teuthology.orchestra.run.trial154.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 2.4 MB/s | 86 kB 00:00 2026-02-13T02:38:01.613 INFO:teuthology.orchestra.run.trial154.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 2.5 MB/s | 90 kB 00:00 2026-02-13T02:38:01.614 INFO:teuthology.orchestra.run.trial154.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 637 kB/s | 22 kB 00:00 2026-02-13T02:38:01.624 INFO:teuthology.orchestra.run.trial154.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 635 kB/s | 20 kB 00:00 2026-02-13T02:38:01.654 INFO:teuthology.orchestra.run.trial154.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 4.6 MB/s | 191 kB 00:00 2026-02-13T02:38:01.687 INFO:teuthology.orchestra.run.trial091.stdout:(153/173): python3-tempora-5.0.0-2.el9.noarch.r 170 kB/s | 36 kB 00:00 2026-02-13T02:38:01.722 INFO:teuthology.orchestra.run.trial091.stdout:(154/173): python3-routes-2.5.1-5.el9.noarch.rp 524 kB/s | 188 kB 00:00 2026-02-13T02:38:01.738 INFO:teuthology.orchestra.run.trial091.stdout:(155/173): python3-rsa-4.9-2.el9.noarch.rpm 206 kB/s | 59 kB 00:00 2026-02-13T02:38:01.739 INFO:teuthology.orchestra.run.trial154.stdout:(161/173): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-13T02:38:01.744 INFO:teuthology.orchestra.run.trial154.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.0 MB/s | 122 kB 00:00 2026-02-13T02:38:01.811 INFO:teuthology.orchestra.run.trial154.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 22 MB/s | 3.5 MB 00:00 2026-02-13T02:38:01.895 INFO:teuthology.orchestra.run.trial154.stdout:(164/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 18 MB/s | 2.8 MB 00:00 2026-02-13T02:38:01.916 INFO:teuthology.orchestra.run.trial078.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 3.9 MB/s | 2.3 MB 00:00 2026-02-13T02:38:01.919 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:38:01.919 INFO:teuthology.orchestra.run.trial078.stdout:Total 21 MB/s | 302 MB 00:14 2026-02-13T02:38:01.955 INFO:teuthology.orchestra.run.trial091.stdout:(156/173): python3-xmltodict-0.12.0-15.el9.noar 102 kB/s | 22 kB 00:00 2026-02-13T02:38:01.977 INFO:teuthology.orchestra.run.trial091.stdout:(157/173): python3-typing-extensions-4.15.0-1.e 298 kB/s | 86 kB 00:00 2026-02-13T02:38:02.001 INFO:teuthology.orchestra.run.trial091.stdout:(158/173): python3-websocket-client-1.2.3-2.el9 322 kB/s | 90 kB 00:00 2026-02-13T02:38:02.173 INFO:teuthology.orchestra.run.trial091.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 92 kB/s | 20 kB 00:00 2026-02-13T02:38:02.328 INFO:teuthology.orchestra.run.trial091.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 545 kB/s | 191 kB 00:00 2026-02-13T02:38:02.377 INFO:teuthology.orchestra.run.trial154.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 77 kB/s | 37 kB 00:00 2026-02-13T02:38:02.464 INFO:teuthology.orchestra.run.trial091.stdout:(161/173): librados2-20.3.0-5241.g8f8d3829.el9. 26 MB/s | 3.5 MB 00:00 2026-02-13T02:38:02.518 INFO:teuthology.orchestra.run.trial091.stdout:(162/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 353 kB/s | 122 kB 00:00 2026-02-13T02:38:02.529 INFO:teuthology.orchestra.run.trial154.stdout:(166/173): NetworkManager-1.54.3-2.el9.x86_64.r 3.0 MB/s | 2.4 MB 00:00 2026-02-13T02:38:02.534 INFO:teuthology.orchestra.run.trial091.stdout:(163/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 40 MB/s | 2.8 MB 00:00 2026-02-13T02:38:02.573 INFO:teuthology.orchestra.run.trial091.stdout:(164/173): thrift-0.15.0-4.el9.x86_64.rpm 2.8 MB/s | 1.6 MB 00:00 2026-02-13T02:38:02.741 INFO:teuthology.orchestra.run.trial154.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 680 kB/s | 248 kB 00:00 2026-02-13T02:38:02.766 INFO:teuthology.orchestra.run.trial154.stdout:(168/173): iproute-6.17.0-2.el9.x86_64.rpm 3.6 MB/s | 866 kB 00:00 2026-02-13T02:38:02.838 INFO:teuthology.orchestra.run.trial154.stdout:(169/173): NetworkManager-libnm-1.54.3-2.el9.x8 1.9 MB/s | 1.9 MB 00:01 2026-02-13T02:38:02.901 INFO:teuthology.orchestra.run.trial154.stdout:(170/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 2.8 MB/s | 454 kB 00:00 2026-02-13T02:38:03.006 INFO:teuthology.orchestra.run.trial154.stdout:(171/173): openssl-3.5.5-1.el9.x86_64.rpm 6.2 MB/s | 1.5 MB 00:00 2026-02-13T02:38:03.009 INFO:teuthology.orchestra.run.trial154.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 4.6 MB/s | 814 kB 00:00 2026-02-13T02:38:03.170 INFO:teuthology.orchestra.run.trial091.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 62 kB/s | 37 kB 00:00 2026-02-13T02:38:03.443 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-13T02:38:03.457 INFO:teuthology.orchestra.run.trial154.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 4.1 MB/s | 2.3 MB 00:00 2026-02-13T02:38:03.463 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:38:03.464 INFO:teuthology.orchestra.run.trial154.stdout:Total 20 MB/s | 302 MB 00:14 2026-02-13T02:38:03.540 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-13T02:38:03.540 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-13T02:38:03.569 INFO:teuthology.orchestra.run.trial091.stdout:(166/173): NetworkManager-libnm-1.54.3-2.el9.x8 1.8 MB/s | 1.9 MB 00:01 2026-02-13T02:38:03.588 INFO:teuthology.orchestra.run.trial091.stdout:(167/173): NetworkManager-tui-1.54.3-2.el9.x86_ 593 kB/s | 248 kB 00:00 2026-02-13T02:38:03.742 INFO:teuthology.orchestra.run.trial091.stdout:(168/173): iproute-6.17.0-2.el9.x86_64.rpm 4.9 MB/s | 866 kB 00:00 2026-02-13T02:38:03.964 INFO:teuthology.orchestra.run.trial091.stdout:(169/173): NetworkManager-1.54.3-2.el9.x86_64.r 1.6 MB/s | 2.4 MB 00:01 2026-02-13T02:38:03.986 INFO:teuthology.orchestra.run.trial091.stdout:(170/173): openssl-3.5.5-1.el9.x86_64.rpm 6.1 MB/s | 1.5 MB 00:00 2026-02-13T02:38:04.013 INFO:teuthology.orchestra.run.trial091.stdout:(171/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 1.0 MB/s | 454 kB 00:00 2026-02-13T02:38:04.133 INFO:teuthology.orchestra.run.trial091.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 4.7 MB/s | 814 kB 00:00 2026-02-13T02:38:04.252 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-13T02:38:04.314 INFO:teuthology.orchestra.run.trial091.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 7.0 MB/s | 2.3 MB 00:00 2026-02-13T02:38:04.318 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:38:04.318 INFO:teuthology.orchestra.run.trial091.stdout:Total 17 MB/s | 302 MB 00:18 2026-02-13T02:38:04.321 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-13T02:38:04.321 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-13T02:38:04.803 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-13T02:38:04.804 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-13T02:38:05.103 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-13T02:38:05.174 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-13T02:38:05.174 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-13T02:38:05.409 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-13T02:38:05.409 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-13T02:38:06.142 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-13T02:38:06.147 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T02:38:06.158 INFO:teuthology.orchestra.run.trial078.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T02:38:06.175 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T02:38:06.183 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T02:38:06.187 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T02:38:06.194 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T02:38:06.255 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T02:38:06.261 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T02:38:06.261 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-13T02:38:06.262 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-13T02:38:06.322 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:06.329 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:06.486 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:06.492 INFO:teuthology.orchestra.run.trial078.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T02:38:06.533 INFO:teuthology.orchestra.run.trial078.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T02:38:06.566 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T02:38:06.569 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-13T02:38:06.572 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T02:38:06.580 INFO:teuthology.orchestra.run.trial154.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T02:38:06.583 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T02:38:06.590 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T02:38:06.591 INFO:teuthology.orchestra.run.trial154.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T02:38:06.595 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T02:38:06.597 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T02:38:06.599 INFO:teuthology.orchestra.run.trial078.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T02:38:06.601 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T02:38:06.608 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T02:38:06.614 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T02:38:06.621 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T02:38:06.642 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T02:38:06.648 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T02:38:06.657 INFO:teuthology.orchestra.run.trial078.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T02:38:06.677 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T02:38:06.688 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T02:38:06.688 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:06.691 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:06.694 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T02:38:06.702 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T02:38:06.705 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T02:38:06.709 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T02:38:06.724 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T02:38:06.773 INFO:teuthology.orchestra.run.trial078.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T02:38:06.781 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T02:38:06.784 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T02:38:06.785 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T02:38:06.794 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:06.798 INFO:teuthology.orchestra.run.trial154.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T02:38:06.826 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T02:38:06.833 INFO:teuthology.orchestra.run.trial154.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T02:38:06.838 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T02:38:06.854 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T02:38:06.865 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T02:38:06.869 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T02:38:06.874 INFO:teuthology.orchestra.run.trial154.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T02:38:06.874 INFO:teuthology.orchestra.run.trial078.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T02:38:06.879 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T02:38:06.882 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T02:38:06.883 INFO:teuthology.orchestra.run.trial078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T02:38:06.887 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T02:38:06.887 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T02:38:06.892 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T02:38:06.897 INFO:teuthology.orchestra.run.trial078.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T02:38:06.910 INFO:teuthology.orchestra.run.trial154.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T02:38:06.923 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T02:38:06.928 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T02:38:06.933 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T02:38:06.937 INFO:teuthology.orchestra.run.trial078.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T02:38:06.939 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T02:38:06.940 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T02:38:06.943 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T02:38:06.953 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T02:38:06.988 INFO:teuthology.orchestra.run.trial154.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T02:38:06.992 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T02:38:06.994 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T02:38:06.995 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T02:38:07.012 INFO:teuthology.orchestra.run.trial078.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T02:38:07.017 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T02:38:07.023 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T02:38:07.032 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T02:38:07.041 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T02:38:07.047 INFO:teuthology.orchestra.run.trial154.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T02:38:07.052 INFO:teuthology.orchestra.run.trial154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T02:38:07.053 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T02:38:07.054 INFO:teuthology.orchestra.run.trial154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T02:38:07.057 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T02:38:07.060 INFO:teuthology.orchestra.run.trial154.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T02:38:07.079 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T02:38:07.087 INFO:teuthology.orchestra.run.trial154.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T02:38:07.088 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T02:38:07.139 INFO:teuthology.orchestra.run.trial154.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T02:38:07.152 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T02:38:07.157 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T02:38:07.165 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T02:38:07.181 INFO:teuthology.orchestra.run.trial154.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T02:38:07.188 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T02:38:07.251 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T02:38:07.254 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T02:38:07.346 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T02:38:07.350 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T02:38:07.412 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T02:38:07.415 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T02:38:07.427 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-13T02:38:07.430 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T02:38:07.440 INFO:teuthology.orchestra.run.trial091.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T02:38:07.451 INFO:teuthology.orchestra.run.trial091.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T02:38:07.455 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T02:38:07.457 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T02:38:07.462 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T02:38:07.479 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T02:38:07.481 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T02:38:07.490 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T02:38:07.492 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T02:38:07.504 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T02:38:07.510 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T02:38:07.522 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T02:38:07.526 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T02:38:07.538 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T02:38:07.541 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T02:38:07.542 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T02:38:07.543 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T02:38:07.544 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:07.547 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:07.569 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T02:38:07.571 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T02:38:07.579 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T02:38:07.582 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T02:38:07.632 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T02:38:07.642 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T02:38:07.651 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T02:38:07.651 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T02:38:07.655 INFO:teuthology.orchestra.run.trial091.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T02:38:07.655 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T02:38:07.660 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T02:38:07.661 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T02:38:07.665 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T02:38:07.665 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T02:38:07.685 INFO:teuthology.orchestra.run.trial091.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T02:38:07.687 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T02:38:07.688 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T02:38:07.696 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T02:38:07.699 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T02:38:07.707 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T02:38:07.716 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T02:38:07.717 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T02:38:07.721 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T02:38:07.724 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T02:38:07.726 INFO:teuthology.orchestra.run.trial091.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T02:38:07.732 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T02:38:07.733 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T02:38:07.735 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T02:38:07.739 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T02:38:07.740 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T02:38:07.745 INFO:teuthology.orchestra.run.trial154.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T02:38:07.750 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T02:38:07.763 INFO:teuthology.orchestra.run.trial091.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T02:38:07.763 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T02:38:07.775 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T02:38:07.782 INFO:teuthology.orchestra.run.trial078.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T02:38:07.782 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T02:38:07.785 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T02:38:07.791 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T02:38:07.793 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T02:38:07.794 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T02:38:07.802 INFO:teuthology.orchestra.run.trial154.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T02:38:07.804 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T02:38:07.832 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T02:38:07.839 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T02:38:07.839 INFO:teuthology.orchestra.run.trial091.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T02:38:07.843 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T02:38:07.844 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T02:38:07.846 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T02:38:07.846 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T02:38:07.857 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T02:38:07.862 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T02:38:07.867 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T02:38:07.869 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T02:38:07.875 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T02:38:07.879 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T02:38:07.880 INFO:teuthology.orchestra.run.trial078.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T02:38:07.884 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T02:38:07.893 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T02:38:07.897 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T02:38:07.899 INFO:teuthology.orchestra.run.trial091.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T02:38:07.904 INFO:teuthology.orchestra.run.trial091.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T02:38:07.905 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T02:38:07.907 INFO:teuthology.orchestra.run.trial091.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T02:38:07.911 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T02:38:07.914 INFO:teuthology.orchestra.run.trial091.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T02:38:07.930 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T02:38:07.941 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T02:38:07.942 INFO:teuthology.orchestra.run.trial091.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T02:38:07.945 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T02:38:07.947 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T02:38:07.969 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T02:38:07.977 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T02:38:07.985 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T02:38:07.995 INFO:teuthology.orchestra.run.trial091.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T02:38:08.003 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T02:38:08.008 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T02:38:08.012 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T02:38:08.014 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T02:38:08.023 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T02:38:08.026 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T02:38:08.034 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T02:38:08.040 INFO:teuthology.orchestra.run.trial091.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T02:38:08.046 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T02:38:08.047 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T02:38:08.107 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T02:38:08.196 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T02:38:08.201 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T02:38:08.272 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T02:38:08.283 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T02:38:08.287 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T02:38:08.293 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T02:38:08.296 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T02:38:08.303 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T02:38:08.305 INFO:teuthology.orchestra.run.trial154.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T02:38:08.307 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T02:38:08.335 INFO:teuthology.orchestra.run.trial154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T02:38:08.338 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T02:38:08.339 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T02:38:08.379 INFO:teuthology.orchestra.run.trial154.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T02:38:08.382 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T02:38:08.386 INFO:teuthology.orchestra.run.trial154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T02:38:08.390 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T02:38:08.391 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T02:38:08.392 INFO:teuthology.orchestra.run.trial154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T02:38:08.420 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T02:38:08.421 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T02:38:08.423 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T02:38:08.427 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T02:38:08.430 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T02:38:08.431 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T02:38:08.434 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T02:38:08.436 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T02:38:08.440 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T02:38:08.447 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T02:38:08.450 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T02:38:08.478 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T02:38:08.488 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T02:38:08.494 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T02:38:08.495 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T02:38:08.501 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T02:38:08.510 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T02:38:08.517 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T02:38:08.518 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T02:38:08.536 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T02:38:08.540 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T02:38:08.541 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T02:38:08.546 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T02:38:08.568 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T02:38:08.569 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T02:38:08.576 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T02:38:08.585 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T02:38:08.587 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T02:38:08.594 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T02:38:08.597 INFO:teuthology.orchestra.run.trial091.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T02:38:08.604 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T02:38:08.610 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T02:38:08.620 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T02:38:08.624 INFO:teuthology.orchestra.run.trial078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T02:38:08.627 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T02:38:08.654 INFO:teuthology.orchestra.run.trial091.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T02:38:08.673 INFO:teuthology.orchestra.run.trial078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T02:38:08.684 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T02:38:08.690 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T02:38:08.694 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T02:38:08.708 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T02:38:08.712 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T02:38:08.718 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T02:38:08.729 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T02:38:08.734 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T02:38:08.738 INFO:teuthology.orchestra.run.trial078.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T02:38:08.743 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T02:38:08.746 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T02:38:08.747 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T02:38:08.752 INFO:teuthology.orchestra.run.trial078.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T02:38:08.755 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T02:38:08.762 INFO:teuthology.orchestra.run.trial078.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T02:38:08.771 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T02:38:08.795 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T02:38:08.795 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T02:38:08.799 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T02:38:08.803 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T02:38:08.815 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T02:38:08.821 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T02:38:08.831 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T02:38:08.837 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T02:38:08.848 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T02:38:08.854 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T02:38:08.857 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T02:38:08.859 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T02:38:08.880 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T02:38:08.895 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T02:38:08.911 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T02:38:08.922 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T02:38:08.933 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T02:38:08.984 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T02:38:09.002 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T02:38:09.122 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T02:38:09.132 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T02:38:09.136 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T02:38:09.142 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T02:38:09.147 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T02:38:09.153 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T02:38:09.155 INFO:teuthology.orchestra.run.trial091.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T02:38:09.157 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T02:38:09.186 INFO:teuthology.orchestra.run.trial091.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T02:38:09.209 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T02:38:09.229 INFO:teuthology.orchestra.run.trial091.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T02:38:09.233 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T02:38:09.237 INFO:teuthology.orchestra.run.trial091.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T02:38:09.243 INFO:teuthology.orchestra.run.trial091.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T02:38:09.271 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T02:38:09.278 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T02:38:09.281 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T02:38:09.283 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T02:38:09.287 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T02:38:09.290 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T02:38:09.298 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T02:38:09.301 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T02:38:09.306 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T02:38:09.329 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T02:38:09.339 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T02:38:09.344 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T02:38:09.345 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T02:38:09.351 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T02:38:09.352 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T02:38:09.386 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T02:38:09.397 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T02:38:09.425 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T02:38:09.429 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T02:38:09.456 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T02:38:09.622 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T02:38:09.646 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T02:38:09.650 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T02:38:09.708 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T02:38:09.710 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T02:38:09.731 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T02:38:09.918 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T02:38:09.961 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T02:38:09.976 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T02:38:09.979 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T02:38:09.981 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T02:38:09.987 INFO:teuthology.orchestra.run.trial154.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T02:38:10.031 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T02:38:10.060 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T02:38:10.134 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T02:38:10.274 INFO:teuthology.orchestra.run.trial154.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T02:38:10.275 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T02:38:10.296 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T02:38:10.297 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T02:38:10.811 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T02:38:10.826 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T02:38:10.829 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T02:38:10.831 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T02:38:10.837 INFO:teuthology.orchestra.run.trial091.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T02:38:10.988 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T02:38:11.022 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T02:38:11.027 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T02:38:11.031 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T02:38:11.040 INFO:teuthology.orchestra.run.trial078.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T02:38:11.118 INFO:teuthology.orchestra.run.trial091.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T02:38:11.119 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T02:38:11.139 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T02:38:11.140 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T02:38:11.342 INFO:teuthology.orchestra.run.trial078.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T02:38:11.345 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T02:38:11.382 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T02:38:11.385 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T02:38:11.432 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:11.434 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:11.453 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:11.467 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T02:38:11.483 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T02:38:11.558 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T02:38:11.567 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T02:38:11.591 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T02:38:11.620 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T02:38:11.671 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T02:38:11.677 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T02:38:11.681 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T02:38:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T02:38:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T02:38:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T02:38:11.705 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T02:38:11.956 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T02:38:11.959 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T02:38:12.001 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T02:38:12.001 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T02:38:12.001 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T02:38:12.001 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:12.005 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T02:38:12.234 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:12.237 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:12.257 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:12.272 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T02:38:12.288 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T02:38:12.364 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T02:38:12.373 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T02:38:12.397 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T02:38:12.427 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T02:38:12.478 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T02:38:12.484 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T02:38:12.488 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T02:38:12.492 INFO:teuthology.orchestra.run.trial091.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T02:38:12.494 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T02:38:12.495 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T02:38:12.512 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T02:38:12.603 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:12.610 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:12.647 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T02:38:12.668 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T02:38:12.691 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T02:38:12.759 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T02:38:12.790 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T02:38:12.804 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T02:38:12.822 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T02:38:12.829 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T02:38:12.829 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T02:38:12.829 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T02:38:12.829 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:12.833 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T02:38:12.856 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T02:38:12.901 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T02:38:12.974 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T02:38:12.985 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T02:38:12.992 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T02:38:12.999 INFO:teuthology.orchestra.run.trial078.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T02:38:13.003 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T02:38:13.005 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T02:38:13.042 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T02:38:13.328 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T02:38:13.336 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T02:38:13.409 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T02:38:13.409 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T02:38:13.410 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T02:38:13.410 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:13.416 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T02:38:16.742 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T02:38:16.742 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /sys 2026-02-13T02:38:16.742 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /proc 2026-02-13T02:38:16.742 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /mnt 2026-02-13T02:38:16.742 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /var/tmp 2026-02-13T02:38:16.742 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /home 2026-02-13T02:38:16.742 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /root 2026-02-13T02:38:16.743 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /tmp 2026-02-13T02:38:16.743 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:16.845 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T02:38:16.866 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T02:38:16.867 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:16.867 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T02:38:16.867 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T02:38:16.867 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T02:38:16.867 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:17.087 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T02:38:17.107 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T02:38:17.108 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:17.108 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T02:38:17.108 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T02:38:17.108 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T02:38:17.108 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:17.113 INFO:teuthology.orchestra.run.trial154.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T02:38:17.115 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T02:38:17.134 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:17.134 INFO:teuthology.orchestra.run.trial154.stdout:Creating group 'qat' with GID 992. 2026-02-13T02:38:17.134 INFO:teuthology.orchestra.run.trial154.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T02:38:17.134 INFO:teuthology.orchestra.run.trial154.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T02:38:17.134 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:17.142 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:17.167 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:17.167 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T02:38:17.167 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:17.203 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /sys 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /proc 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /mnt 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /var/tmp 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /home 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /root 2026-02-13T02:38:17.542 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /tmp 2026-02-13T02:38:17.543 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:17.643 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T02:38:17.665 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T02:38:17.666 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:17.666 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T02:38:17.666 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T02:38:17.666 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T02:38:17.666 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:17.851 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T02:38:17.878 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T02:38:17.900 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T02:38:17.900 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:17.900 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T02:38:17.900 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T02:38:17.900 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T02:38:17.900 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:17.907 INFO:teuthology.orchestra.run.trial091.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T02:38:17.909 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T02:38:17.928 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:17.928 INFO:teuthology.orchestra.run.trial091.stdout:Creating group 'qat' with GID 992. 2026-02-13T02:38:17.928 INFO:teuthology.orchestra.run.trial091.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T02:38:17.928 INFO:teuthology.orchestra.run.trial091.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T02:38:17.928 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:17.936 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:17.960 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:17.960 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T02:38:17.960 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:17.996 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T02:38:18.616 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T02:38:18.638 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T02:38:18.701 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T02:38:18.703 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T02:38:18.717 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T02:38:18.717 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:18.717 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T02:38:18.717 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:18.727 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T02:38:18.749 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T02:38:18.749 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:18.750 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T02:38:18.750 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T02:38:18.750 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T02:38:18.750 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:18.810 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T02:38:18.812 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T02:38:18.821 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T02:38:18.845 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T02:38:18.846 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T02:38:19.372 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T02:38:19.435 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T02:38:19.437 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T02:38:19.451 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T02:38:19.451 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:19.452 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T02:38:19.452 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:19.452 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T02:38:19.452 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /sys 2026-02-13T02:38:19.452 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /proc 2026-02-13T02:38:19.452 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /mnt 2026-02-13T02:38:19.453 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /var/tmp 2026-02-13T02:38:19.453 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /home 2026-02-13T02:38:19.453 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /root 2026-02-13T02:38:19.453 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /tmp 2026-02-13T02:38:19.453 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:19.462 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T02:38:19.485 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T02:38:19.485 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:19.485 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T02:38:19.485 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T02:38:19.485 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T02:38:19.485 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:19.544 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T02:38:19.546 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T02:38:19.555 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T02:38:19.567 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T02:38:19.579 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T02:38:19.580 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T02:38:19.614 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T02:38:19.615 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:19.615 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T02:38:19.615 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T02:38:19.615 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T02:38:19.615 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:19.850 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T02:38:19.896 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T02:38:19.897 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:19.897 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T02:38:19.897 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T02:38:19.897 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T02:38:19.897 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:19.907 INFO:teuthology.orchestra.run.trial078.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T02:38:19.910 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T02:38:19.947 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:19.947 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'qat' with GID 992. 2026-02-13T02:38:19.947 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T02:38:19.947 INFO:teuthology.orchestra.run.trial078.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T02:38:19.948 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:19.961 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:20.013 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T02:38:20.013 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T02:38:20.013 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:20.065 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T02:38:20.428 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T02:38:20.435 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T02:38:20.725 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T02:38:20.903 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T02:38:20.953 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T02:38:20.966 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T02:38:21.007 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T02:38:21.008 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T02:38:21.029 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T02:38:21.029 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.029 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T02:38:21.029 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T02:38:21.030 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T02:38:21.030 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:21.041 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T02:38:21.050 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T02:38:21.142 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T02:38:21.149 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T02:38:21.527 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T02:38:21.603 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T02:38:21.604 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T02:38:21.615 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T02:38:21.621 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T02:38:21.645 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T02:38:21.647 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T02:38:21.656 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T02:38:21.656 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.656 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T02:38:21.656 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:21.665 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T02:38:21.668 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T02:38:21.668 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.669 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T02:38:21.669 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:38:21.669 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:38:21.669 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:21.670 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T02:38:21.677 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T02:38:21.697 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T02:38:21.697 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.697 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T02:38:21.697 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:21.706 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T02:38:21.708 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T02:38:21.710 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T02:38:21.724 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T02:38:21.724 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.724 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T02:38:21.724 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T02:38:21.724 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T02:38:21.724 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:21.729 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T02:38:21.729 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.729 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T02:38:21.729 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T02:38:21.729 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T02:38:21.729 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:21.731 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T02:38:21.731 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.731 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T02:38:21.731 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:38:21.731 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:38:21.731 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:21.740 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T02:38:21.749 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T02:38:21.845 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T02:38:21.848 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T02:38:21.861 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T02:38:21.861 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T02:38:21.882 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T02:38:21.882 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:21.882 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T02:38:21.883 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T02:38:21.883 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T02:38:21.883 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:21.894 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T02:38:21.898 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T02:38:22.320 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T02:38:22.322 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T02:38:22.343 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T02:38:22.343 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:22.343 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T02:38:22.343 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:38:22.343 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:38:22.343 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:22.352 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T02:38:22.372 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T02:38:22.372 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:22.373 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T02:38:22.373 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:22.385 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T02:38:22.405 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T02:38:22.405 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:22.405 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T02:38:22.405 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:38:22.405 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:38:22.406 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:22.531 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T02:38:22.552 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T02:38:22.552 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:22.552 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T02:38:22.552 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T02:38:22.552 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T02:38:22.552 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:23.764 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T02:38:23.779 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T02:38:24.283 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T02:38:24.286 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T02:38:24.381 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T02:38:24.430 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T02:38:24.433 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T02:38:24.479 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T02:38:24.479 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:24.479 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T02:38:24.480 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T02:38:24.480 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T02:38:24.480 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:24.497 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T02:38:24.518 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T02:38:25.132 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T02:38:25.136 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T02:38:25.185 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T02:38:25.185 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:25.185 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T02:38:25.185 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:38:25.185 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T02:38:25.186 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:25.198 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T02:38:25.243 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T02:38:25.243 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:25.243 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T02:38:25.243 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:25.260 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T02:38:25.305 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T02:38:25.305 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:25.305 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T02:38:25.305 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:38:25.305 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T02:38:25.306 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:25.430 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T02:38:25.444 INFO:teuthology.orchestra.run.trial154.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T02:38:25.444 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T02:38:25.447 INFO:teuthology.orchestra.run.trial154.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T02:38:25.489 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T02:38:25.489 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T02:38:25.490 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T02:38:25.490 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T02:38:25.490 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T02:38:25.490 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:25.521 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T02:38:25.539 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T02:38:25.543 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T02:38:25.545 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T02:38:25.663 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:25.667 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:25.684 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:25.689 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T02:38:25.698 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T02:38:25.743 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T02:38:25.980 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T02:38:25.993 INFO:teuthology.orchestra.run.trial091.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T02:38:25.997 INFO:teuthology.orchestra.run.trial091.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T02:38:26.071 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T02:38:26.089 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T02:38:26.094 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T02:38:26.095 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T02:38:26.198 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T02:38:26.214 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:26.218 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:26.223 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T02:38:26.224 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T02:38:26.228 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T02:38:26.229 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T02:38:26.235 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:26.238 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T02:38:26.241 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T02:38:26.250 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T02:38:26.266 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T02:38:26.269 INFO:teuthology.orchestra.run.trial154.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T02:38:26.271 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T02:38:26.275 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T02:38:26.275 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T02:38:26.288 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T02:38:26.288 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T02:38:26.292 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T02:38:26.300 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T02:38:26.302 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T02:38:26.303 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T02:38:26.305 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T02:38:26.311 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:26.311 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:26.401 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:26.404 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T02:38:26.406 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T02:38:26.408 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:26.414 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T02:38:26.422 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T02:38:26.445 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T02:38:26.745 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T02:38:26.769 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T02:38:26.771 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T02:38:26.774 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T02:38:26.775 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T02:38:26.784 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T02:38:26.811 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T02:38:26.814 INFO:teuthology.orchestra.run.trial091.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T02:38:26.816 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T02:38:26.820 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T02:38:26.820 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T02:38:26.834 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T02:38:26.834 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T02:38:26.847 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T02:38:26.848 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T02:38:26.850 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T02:38:26.851 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T02:38:26.857 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:26.857 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:26.946 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:26.949 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T02:38:26.952 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T02:38:26.954 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:26.960 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T02:38:26.967 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T02:38:26.990 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T02:38:27.395 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T02:38:27.396 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T02:38:27.397 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T02:38:27.398 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T02:38:27.399 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T02:38:27.400 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T02:38:27.400 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T02:38:27.400 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T02:38:27.400 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T02:38:27.400 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T02:38:27.400 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T02:38:27.471 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:27.471 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:27.471 INFO:teuthology.orchestra.run.trial154.stdout:Upgraded: 2026-02-13T02:38:27.471 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.471 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.471 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.471 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T02:38:27.472 INFO:teuthology.orchestra.run.trial154.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.473 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.474 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T02:38:27.475 INFO:teuthology.orchestra.run.trial154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T02:38:27.476 INFO:teuthology.orchestra.run.trial154.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T02:38:27.477 INFO:teuthology.orchestra.run.trial154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T02:38:27.478 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.479 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T02:38:27.480 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T02:38:27.481 INFO:teuthology.orchestra.run.trial154.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.482 INFO:teuthology.orchestra.run.trial154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T02:38:27.483 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T02:38:27.484 INFO:teuthology.orchestra.run.trial154.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T02:38:27.485 INFO:teuthology.orchestra.run.trial154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T02:38:27.485 INFO:teuthology.orchestra.run.trial154.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T02:38:27.485 INFO:teuthology.orchestra.run.trial154.stdout: zip-3.0-35.el9.x86_64 2026-02-13T02:38:27.485 INFO:teuthology.orchestra.run.trial154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T02:38:27.485 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:38:27.486 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-13T02:38:27.570 DEBUG:teuthology.parallel:result is None 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T02:38:27.917 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T02:38:27.918 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T02:38:27.919 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T02:38:27.920 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T02:38:27.921 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T02:38:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T02:38:27.923 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T02:38:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T02:38:27.925 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T02:38:27.926 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T02:38:27.927 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T02:38:27.928 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T02:38:27.929 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T02:38:27.930 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T02:38:27.931 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T02:38:27.984 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:27.984 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:27.984 INFO:teuthology.orchestra.run.trial091.stdout:Upgraded: 2026-02-13T02:38:27.984 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.984 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.984 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.984 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T02:38:27.985 INFO:teuthology.orchestra.run.trial091.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.986 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.987 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T02:38:27.988 INFO:teuthology.orchestra.run.trial091.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T02:38:27.989 INFO:teuthology.orchestra.run.trial091.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T02:38:27.990 INFO:teuthology.orchestra.run.trial091.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T02:38:27.991 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T02:38:27.992 INFO:teuthology.orchestra.run.trial091.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T02:38:27.993 INFO:teuthology.orchestra.run.trial091.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T02:38:27.994 INFO:teuthology.orchestra.run.trial091.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T02:38:27.995 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T02:38:27.996 INFO:teuthology.orchestra.run.trial091.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T02:38:27.997 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: zip-3.0-35.el9.x86_64 2026-02-13T02:38:27.998 INFO:teuthology.orchestra.run.trial091.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T02:38:27.999 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:38:27.999 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-13T02:38:28.082 DEBUG:teuthology.parallel:result is None 2026-02-13T02:38:29.152 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T02:38:29.173 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T02:38:29.179 INFO:teuthology.orchestra.run.trial078.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T02:38:29.288 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T02:38:29.321 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T02:38:29.328 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T02:38:29.331 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T02:38:29.537 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:29.547 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:29.584 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T02:38:29.590 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T02:38:29.602 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T02:38:29.650 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T02:38:30.519 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T02:38:30.566 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T02:38:30.570 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T02:38:30.575 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T02:38:30.579 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T02:38:30.593 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T02:38:30.635 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T02:38:30.642 INFO:teuthology.orchestra.run.trial078.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T02:38:30.646 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T02:38:30.653 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T02:38:30.653 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T02:38:30.682 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T02:38:30.682 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T02:38:30.709 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T02:38:30.711 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T02:38:30.715 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T02:38:30.717 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T02:38:30.731 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:30.731 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:30.875 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T02:38:30.880 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T02:38:30.886 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T02:38:30.889 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:30.903 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T02:38:30.917 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T02:38:30.950 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T02:38:31.103 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:31.103 INFO:teuthology.orchestra.run.trial078.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-13T02:38:31.103 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:32.117 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T02:38:32.118 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T02:38:32.119 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T02:38:32.120 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T02:38:32.121 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T02:38:32.122 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T02:38:32.123 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T02:38:32.124 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T02:38:32.125 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T02:38:32.126 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T02:38:32.127 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T02:38:32.128 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T02:38:32.129 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T02:38:32.130 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T02:38:32.131 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T02:38:32.132 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T02:38:32.132 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T02:38:32.132 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T02:38:32.210 INFO:teuthology.orchestra.run.trial078.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T02:38:32.210 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:32.210 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-13T02:38:32.210 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:32.210 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:32.210 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T02:38:32.211 INFO:teuthology.orchestra.run.trial078.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.212 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.213 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T02:38:32.214 INFO:teuthology.orchestra.run.trial078.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T02:38:32.215 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T02:38:32.216 INFO:teuthology.orchestra.run.trial078.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T02:38:32.217 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T02:38:32.218 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T02:38:32.219 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T02:38:32.220 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T02:38:32.221 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T02:38:32.222 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T02:38:32.223 INFO:teuthology.orchestra.run.trial078.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T02:38:32.224 INFO:teuthology.orchestra.run.trial078.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T02:38:32.224 INFO:teuthology.orchestra.run.trial078.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T02:38:32.224 INFO:teuthology.orchestra.run.trial078.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T02:38:32.224 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T02:38:32.224 INFO:teuthology.orchestra.run.trial078.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T02:38:32.224 INFO:teuthology.orchestra.run.trial078.stdout: zip-3.0-35.el9.x86_64 2026-02-13T02:38:32.224 INFO:teuthology.orchestra.run.trial078.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T02:38:32.225 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:32.225 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-13T02:38:32.468 DEBUG:teuthology.parallel:result is None 2026-02-13T02:38:32.468 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:38:32.645 DEBUG:teuthology.orchestra.run.trial078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T02:38:32.688 INFO:teuthology.orchestra.run.trial078.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T02:38:32.689 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T02:38:32.689 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T02:38:32.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:38:32.855 DEBUG:teuthology.orchestra.run.trial091:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T02:38:32.878 INFO:teuthology.orchestra.run.trial091.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T02:38:32.878 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T02:38:32.878 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T02:38:32.879 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:38:33.012 DEBUG:teuthology.orchestra.run.trial154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T02:38:33.035 INFO:teuthology.orchestra.run.trial154.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T02:38:33.035 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T02:38:33.036 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T02:38:33.038 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T02:38:33.038 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:38:33.039 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:38:33.094 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:38:33.094 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:38:33.122 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:38:33.122 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:38:33.150 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T02:38:33.151 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:38:33.151 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:38:33.205 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:38:33.300 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:38:33.300 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:38:33.325 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:38:33.390 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:38:33.390 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:38:33.418 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:38:33.484 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T02:38:33.484 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:38:33.485 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:38:33.538 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:38:33.632 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:38:33.632 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:38:33.657 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:38:33.720 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:38:33.721 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:38:33.745 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:38:33.810 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T02:38:33.810 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:38:33.811 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:38:33.863 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:38:33.961 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:38:33.961 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:38:33.986 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:38:34.051 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:38:34.051 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:38:34.076 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:38:34.142 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T02:38:34.271 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-13T02:38:34.271 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T02:38:34.273 INFO:tasks.cephadm:Cluster fsid is 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:34.273 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T02:38:34.273 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.78', 'mon.b': '10.20.193.91', 'mon.c': '10.20.193.154'} 2026-02-13T02:38:34.273 INFO:tasks.cephadm:First mon is mon.a on trial078 2026-02-13T02:38:34.273 INFO:tasks.cephadm:First mgr is x 2026-02-13T02:38:34.273 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T02:38:34.273 DEBUG:teuthology.orchestra.run.trial078:> sudo hostname $(hostname -s) 2026-02-13T02:38:34.327 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname $(hostname -s) 2026-02-13T02:38:34.353 DEBUG:teuthology.orchestra.run.trial154:> sudo hostname $(hostname -s) 2026-02-13T02:38:34.379 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T02:38:34.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:38:34.527 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-10 22:03:44.386901', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T02:38:34.666 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:38:34.667 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T02:38:34.668 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T02:38:34.668 DEBUG:teuthology.orchestra.run.trial078:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.030 INFO:teuthology.orchestra.run.trial078.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 02:38 /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.031 DEBUG:teuthology.orchestra.run.trial091:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.325 INFO:teuthology.orchestra.run.trial091.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 02:38 /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.325 DEBUG:teuthology.orchestra.run.trial154:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.623 INFO:teuthology.orchestra.run.trial154.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 02:38 /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.623 DEBUG:teuthology.orchestra.run.trial078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.662 DEBUG:teuthology.orchestra.run.trial091:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.681 DEBUG:teuthology.orchestra.run.trial154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T02:38:35.725 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T02:38:35.725 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T02:38:35.729 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T02:38:35.732 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T02:38:35.884 INFO:teuthology.orchestra.run.trial091.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:38:35.893 INFO:teuthology.orchestra.run.trial154.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:38:36.083 INFO:teuthology.orchestra.run.trial078.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:38:45.933 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-13T02:38:45.933 INFO:teuthology.orchestra.run.trial091.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T02:38:45.933 INFO:teuthology.orchestra.run.trial091.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T02:38:45.933 INFO:teuthology.orchestra.run.trial091.stdout: "repo_digests": [ 2026-02-13T02:38:45.934 INFO:teuthology.orchestra.run.trial091.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T02:38:45.934 INFO:teuthology.orchestra.run.trial091.stdout: ] 2026-02-13T02:38:45.934 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-13T02:38:45.950 INFO:teuthology.orchestra.run.trial154.stdout:{ 2026-02-13T02:38:45.951 INFO:teuthology.orchestra.run.trial154.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T02:38:45.951 INFO:teuthology.orchestra.run.trial154.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T02:38:45.951 INFO:teuthology.orchestra.run.trial154.stdout: "repo_digests": [ 2026-02-13T02:38:45.951 INFO:teuthology.orchestra.run.trial154.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T02:38:45.951 INFO:teuthology.orchestra.run.trial154.stdout: ] 2026-02-13T02:38:45.951 INFO:teuthology.orchestra.run.trial154.stdout:} 2026-02-13T02:38:48.600 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T02:38:48.600 INFO:teuthology.orchestra.run.trial078.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T02:38:48.600 INFO:teuthology.orchestra.run.trial078.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T02:38:48.600 INFO:teuthology.orchestra.run.trial078.stdout: "repo_digests": [ 2026-02-13T02:38:48.600 INFO:teuthology.orchestra.run.trial078.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T02:38:48.600 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T02:38:48.600 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T02:38:48.621 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /etc/ceph 2026-02-13T02:38:48.680 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /etc/ceph 2026-02-13T02:38:48.709 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /etc/ceph 2026-02-13T02:38:48.738 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 777 /etc/ceph 2026-02-13T02:38:48.794 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod 777 /etc/ceph 2026-02-13T02:38:48.820 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod 777 /etc/ceph 2026-02-13T02:38:48.846 INFO:tasks.cephadm:Writing seed config... 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T02:38:48.847 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T02:38:48.848 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2026-02-13T02:38:48.849 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:38:48.849 DEBUG:teuthology.orchestra.run.trial078:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T02:38:48.887 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1779b03c-0885-11f1-aeb9-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.2 2026-02-13T02:38:48.887 DEBUG:teuthology.orchestra.run.trial078:mon.a> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a.service 2026-02-13T02:38:48.930 DEBUG:teuthology.orchestra.run.trial078:mgr.x> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.x.service 2026-02-13T02:38:48.975 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T02:38:48.975 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.78 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:38:49.167 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:38:49.167 INFO:teuthology.orchestra.run.trial078.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.78', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T02:38:49.168 INFO:teuthology.orchestra.run.trial078.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T02:38:49.168 INFO:teuthology.orchestra.run.trial078.stdout:Verifying podman|docker is present... 2026-02-13T02:38:49.201 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stdout 5.6.0 2026-02-13T02:38:49.202 INFO:teuthology.orchestra.run.trial078.stdout:Verifying lvm2 is present... 2026-02-13T02:38:49.202 INFO:teuthology.orchestra.run.trial078.stdout:Verifying time synchronization is in place... 2026-02-13T02:38:49.216 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T02:38:49.216 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T02:38:49.226 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T02:38:49.226 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout inactive 2026-02-13T02:38:49.237 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout enabled 2026-02-13T02:38:49.247 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout active 2026-02-13T02:38:49.247 INFO:teuthology.orchestra.run.trial078.stdout:Unit chronyd.service is enabled and running 2026-02-13T02:38:49.247 INFO:teuthology.orchestra.run.trial078.stdout:Repeating the final host check... 2026-02-13T02:38:49.279 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stdout 5.6.0 2026-02-13T02:38:49.279 INFO:teuthology.orchestra.run.trial078.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T02:38:49.280 INFO:teuthology.orchestra.run.trial078.stdout:systemctl is present 2026-02-13T02:38:49.280 INFO:teuthology.orchestra.run.trial078.stdout:lvcreate is present 2026-02-13T02:38:49.289 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T02:38:49.289 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T02:38:49.298 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T02:38:49.299 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout inactive 2026-02-13T02:38:49.310 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout enabled 2026-02-13T02:38:49.320 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout active 2026-02-13T02:38:49.321 INFO:teuthology.orchestra.run.trial078.stdout:Unit chronyd.service is enabled and running 2026-02-13T02:38:49.321 INFO:teuthology.orchestra.run.trial078.stdout:Host looks OK 2026-02-13T02:38:49.321 INFO:teuthology.orchestra.run.trial078.stdout:Cluster fsid: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:49.321 INFO:teuthology.orchestra.run.trial078.stdout:Acquiring lock 140446695923136 on /run/cephadm/1779b03c-0885-11f1-aeb9-d404e6e7d460.lock 2026-02-13T02:38:49.321 INFO:teuthology.orchestra.run.trial078.stdout:Lock 140446695923136 acquired on /run/cephadm/1779b03c-0885-11f1-aeb9-d404e6e7d460.lock 2026-02-13T02:38:49.322 INFO:teuthology.orchestra.run.trial078.stdout:Verifying IP 10.20.193.78 port 3300 ... 2026-02-13T02:38:49.322 INFO:teuthology.orchestra.run.trial078.stdout:Verifying IP 10.20.193.78 port 6789 ... 2026-02-13T02:38:49.322 INFO:teuthology.orchestra.run.trial078.stdout:Base mon IP(s) is [10.20.193.78:3300, 10.20.193.78:6789], mon addrv is [v2:10.20.193.78:3300,v1:10.20.193.78:6789] 2026-02-13T02:38:49.327 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.78 metric 100 2026-02-13T02:38:49.327 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.78 metric 100 2026-02-13T02:38:49.333 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T02:38:49.333 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-13T02:38:49.338 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T02:38:49.338 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T02:38:49.339 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T02:38:49.339 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout 2: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-13T02:38:49.339 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:64ae/64 scope link proto kernel_ll 2026-02-13T02:38:49.339 INFO:teuthology.orchestra.run.trial078.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T02:38:49.339 INFO:teuthology.orchestra.run.trial078.stdout:Mon IP `10.20.193.78` is in CIDR network `10.20.192.0/20` 2026-02-13T02:38:49.340 INFO:teuthology.orchestra.run.trial078.stdout:Mon IP `10.20.193.78` is in CIDR network `10.20.192.0/20` 2026-02-13T02:38:49.340 INFO:teuthology.orchestra.run.trial078.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T02:38:49.340 INFO:teuthology.orchestra.run.trial078.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T02:38:49.340 INFO:teuthology.orchestra.run.trial078.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:38:49.595 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T02:38:49.596 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:38:49.596 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T02:38:49.596 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T02:38:49.596 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T02:38:49.596 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T02:38:49.596 INFO:teuthology.orchestra.run.trial078.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T02:38:49.840 INFO:teuthology.orchestra.run.trial078.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T02:38:49.841 INFO:teuthology.orchestra.run.trial078.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T02:38:49.841 INFO:teuthology.orchestra.run.trial078.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T02:38:50.052 INFO:teuthology.orchestra.run.trial078.stdout:stat: stdout 167 167 2026-02-13T02:38:50.052 INFO:teuthology.orchestra.run.trial078.stdout:Creating initial keys... 2026-02-13T02:38:50.289 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph-authtool: stdout AQC6jo5ph9NlCxAAQdGoiY9zIHL/mUE0U2Lt6g== 2026-02-13T02:38:50.525 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph-authtool: stdout AQC6jo5psbV7GRAA+fUCauMdr6RA8nukPPWCXg== 2026-02-13T02:38:50.757 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph-authtool: stdout AQC6jo5pQgRTJxAAYnLkfQTyo5ovb/VSdQEV7A== 2026-02-13T02:38:50.758 INFO:teuthology.orchestra.run.trial078.stdout:Creating initial monmap... 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:monmaptool for a [v2:10.20.193.78:3300,v1:10.20.193.78:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:setting min_mon_release = tentacle 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/monmaptool: set fsid to 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T02:38:50.949 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:38:50.950 INFO:teuthology.orchestra.run.trial078.stdout:Creating mon... 2026-02-13T02:38:51.208 INFO:teuthology.orchestra.run.trial078.stdout:create mon.a on 2026-02-13T02:38:51.463 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T02:38:51.639 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T02:38:51.830 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460.target → /etc/systemd/system/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460.target. 2026-02-13T02:38:51.831 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460.target → /etc/systemd/system/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460.target. 2026-02-13T02:38:52.049 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a 2026-02-13T02:38:52.049 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a.service: Unit ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a.service not loaded. 2026-02-13T02:38:52.261 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460.target.wants/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@.service. 2026-02-13T02:38:52.534 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T02:38:52.535 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout disabled 2026-02-13T02:38:52.545 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T02:38:52.545 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout inactive 2026-02-13T02:38:52.545 INFO:teuthology.orchestra.run.trial078.stdout:firewalld.service is not enabled 2026-02-13T02:38:52.545 INFO:teuthology.orchestra.run.trial078.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T02:38:52.546 INFO:teuthology.orchestra.run.trial078.stdout:Waiting for mon to start... 2026-02-13T02:38:52.546 INFO:teuthology.orchestra.run.trial078.stdout:Waiting for mon... 2026-02-13T02:38:52.554 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:52 trial078 systemd[1]: Started Ceph mon.a for 1779b03c-0885-11f1-aeb9-d404e6e7d460. 2026-02-13T02:38:52.815 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:52 trial078 ceph-mon[22590]: mkfs 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:52.815 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:52 trial078 ceph-mon[22590]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T02:38:52.849 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T02:38:52.851 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout id: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout services: 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.222385s) [leader: a] 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout data: 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T02:38:52.852 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T02:38:52.853 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:52.853 INFO:teuthology.orchestra.run.trial078.stdout:mon is available 2026-02-13T02:38:52.853 INFO:teuthology.orchestra.run.trial078.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T02:38:53.143 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:53.143 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T02:38:53.143 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout fsid = 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:53.143 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T02:38:53.143 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.78:3300,v1:10.20.193.78:6789] 2026-02-13T02:38:53.143 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T02:38:53.144 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T02:38:53.145 INFO:teuthology.orchestra.run.trial078.stdout:Generating new minimal ceph.conf... 2026-02-13T02:38:53.449 INFO:teuthology.orchestra.run.trial078.stdout:Restarting the monitor... 2026-02-13T02:38:53.684 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 systemd[1]: Stopping Ceph mon.a for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: monmap epoch 1 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: last_changed 2026-02-13T02:38:50.887077+0000 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: created 2026-02-13T02:38:50.887077+0000 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: min_mon_release 20 (tentacle) 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: election_strategy: 1 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: 0: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.a 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: fsmap 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T02:38:53.685 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: mgrmap e1: no daemons active 2026-02-13T02:38:53.686 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: from='client.? 10.20.193.78:0/420016059' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-13T02:38:53.686 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: from='client.? 10.20.193.78:0/3627778553' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T02:38:53.686 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: from='client.? 10.20.193.78:0/3627778553' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-13T02:38:53.686 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-mon[22590]: from='client.? 10.20.193.78:0/2764991969' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:38:53.686 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a[22586]: 2026-02-13T02:38:53.621+0000 7ff41a44e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:38:53.686 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a[22586]: 2026-02-13T02:38:53.621+0000 7ff41a44e6c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T02:38:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 podman[22829]: 2026-02-13 02:38:53.683379473 +0000 UTC m=+0.126145483 container died 635a84024ed704b1713e820be430f68d74f81701fee015aeb5ea01f74ffeadef (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, version=10) 2026-02-13T02:38:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 podman[22829]: 2026-02-13 02:38:53.74514783 +0000 UTC m=+0.187913830 container remove 635a84024ed704b1713e820be430f68d74f81701fee015aeb5ea01f74ffeadef (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, ceph=True, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, version=10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T02:38:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 bash[22829]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a 2026-02-13T02:38:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 systemd[1]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T02:38:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 systemd[1]: Stopped Ceph mon.a for 1779b03c-0885-11f1-aeb9-d404e6e7d460. 2026-02-13T02:38:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:53 trial078 systemd[1]: Starting Ceph mon.a for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:38:54.200 INFO:teuthology.orchestra.run.trial078.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T02:38:54.460 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 podman[22924]: 2026-02-13 02:38:54.004787702 +0000 UTC m=+0.018586238 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 podman[22924]: 2026-02-13 02:38:54.14018651 +0000 UTC m=+0.153985046 container create ed721521e89a29aac75c936543556c3b4fcf37b712b18864a1e128820c84d6cd (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, summary=Rocky Linux Base image, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 podman[22924]: 2026-02-13 02:38:54.182706596 +0000 UTC m=+0.196505132 container init ed721521e89a29aac75c936543556c3b4fcf37b712b18864a1e128820c84d6cd (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, license=BSD-3-Clause, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image) 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 podman[22924]: 2026-02-13 02:38:54.188156697 +0000 UTC m=+0.201955233 container start ed721521e89a29aac75c936543556c3b4fcf37b712b18864a1e128820c84d6cd (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a, org.opencontainers.image.version=10, OSD_FLAVOR=default, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux) 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 bash[22924]: ed721521e89a29aac75c936543556c3b4fcf37b712b18864a1e128820c84d6cd 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 systemd[1]: Started Ceph mon.a for 1779b03c-0885-11f1-aeb9-d404e6e7d460. 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: pidfile_write: ignore empty --pid-file 2026-02-13T02:38:54.461 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: load: jerasure load: lrc 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: RocksDB version: 7.9.2 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Git sha 0 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: DB SUMMARY 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: DB Session ID: DKFUVCR92RRRKB6YV1XH 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: CURRENT file: CURRENT 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96289 ; 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.error_if_exists: 0 2026-02-13T02:38:54.462 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.create_if_missing: 0 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.paranoid_checks: 1 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.env: 0x56284e0b72c0 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.info_log: 0x562877b58ee0 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.statistics: (nil) 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.use_fsync: 0 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_log_file_size: 0 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T02:38:54.463 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.allow_fallocate: 1 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.use_direct_reads: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.db_log_dir: 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.wal_dir: 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T02:38:54.464 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.write_buffer_manager: 0x562877b4fb80 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T02:38:54.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.unordered_write: 0 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.row_cache: None 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.wal_filter: None 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.two_write_queues: 0 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T02:38:54.466 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.wal_compression: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.atomic_flush: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.log_readahead_size: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T02:38:54.467 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_background_jobs: 2 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_background_compactions: -1 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_subcompactions: 1 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_open_files: -1 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T02:38:54.468 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_background_flushes: -1 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Compression algorithms supported: 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kZSTD supported: 0 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kXpressCompression supported: 0 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kBZip2Compression supported: 0 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kLZ4Compression supported: 1 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kZlibCompression supported: 1 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: kSnappyCompression supported: 1 2026-02-13T02:38:54.469 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.merge_operator: 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_filter: None 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562877cd83e0) 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout: cache_index_and_filter_blocks: 1 2026-02-13T02:38:54.470 INFO:journalctl@ceph.mon.a.trial078.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: pin_top_level_index_and_filter: 1 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: index_type: 0 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: data_block_index_type: 0 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: index_shortening: 1 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: checksum: 4 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: no_block_cache: 0 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: block_cache: 0x562877b51690 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: block_cache_name: BinnedLRUCache 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: block_cache_options: 2026-02-13T02:38:54.471 INFO:journalctl@ceph.mon.a.trial078.stdout: capacity : 536870912 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: num_shard_bits : 4 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: strict_capacity_limit : 0 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: high_pri_pool_ratio: 0.000 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: block_cache_compressed: (nil) 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: persistent_cache: (nil) 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: block_size: 4096 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: block_size_deviation: 10 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: block_restart_interval: 16 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: index_block_restart_interval: 1 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: metadata_block_size: 4096 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: partition_filters: 0 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: use_delta_encoding: 1 2026-02-13T02:38:54.472 INFO:journalctl@ceph.mon.a.trial078.stdout: filter_policy: bloomfilter 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: whole_key_filtering: 1 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: verify_compression: 0 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: read_amp_bytes_per_bit: 0 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: format_version: 5 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: enable_index_compression: 1 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: block_align: 0 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: max_auto_readahead_size: 262144 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: prepopulate_block_cache: 0 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: initial_auto_readahead_size: 8192 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T02:38:54.473 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression: NoCompression 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.num_levels: 7 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T02:38:54.474 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T02:38:54.475 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T02:38:54.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T02:38:54.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.inplace_update_support: 0 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.bloom_locality: 0 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.max_successive_merges: 0 2026-02-13T02:38:54.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.ttl: 2592000 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.enable_blob_files: false 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.min_blob_size: 0 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T02:38:54.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 32b859cf-3205-4250-8fbd-bdcb2953239c 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770950334216512, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770950334217616, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92640, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 278, "table_properties": {"data_size": 90689, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11979, "raw_average_key_size": 48, "raw_value_size": 83930, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 245, "num_filter_entries": 245, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770950334, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "32b859cf-3205-4250-8fbd-bdcb2953239c", "db_session_id": "DKFUVCR92RRRKB6YV1XH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770950334217727, "job": 1, "event": "recovery_finished"} 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T02:38:54.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562877b74e00 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: DB pointer 0x56287897e000 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: ** DB Stats ** 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T02:38:54.481 INFO:journalctl@ceph.mon.a.trial078.stdout: 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: ** Compaction Stats [default] ** 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: L0 2/0 92.34 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: Sum 2/0 92.34 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 120.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: ** Compaction Stats [default] ** 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T02:38:54.482 INFO:journalctl@ceph.mon.a.trial078.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 120.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: Cumulative compaction: 0.00 GB write, 12.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: Interval compaction: 0.00 GB write, 12.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T02:38:54.483 INFO:journalctl@ceph.mon.a.trial078.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: Block cache BinnedLRUCache@0x562877b51690#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 7e-06 secs_since: 0 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: starting mon.a rank 0 at public addrs [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] at bind addrs [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???) e1 preinit fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???).mds e1 new map 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???).mds e1 print_map 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: e1 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: btime 2026-02-13T02:38:52:551729+0000 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T02:38:54.484 INFO:journalctl@ceph.mon.a.trial078.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout: legacy client fscid: -1 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout: 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout: No filesystems configured 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: monmap epoch 1 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: last_changed 2026-02-13T02:38:50.887077+0000 2026-02-13T02:38:54.485 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: created 2026-02-13T02:38:50.887077+0000 2026-02-13T02:38:54.486 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: min_mon_release 20 (tentacle) 2026-02-13T02:38:54.486 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: election_strategy: 1 2026-02-13T02:38:54.486 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: 0: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.a 2026-02-13T02:38:54.486 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: fsmap 2026-02-13T02:38:54.486 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T02:38:54.486 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:54 trial078 ceph-mon[22944]: mgrmap e1: no daemons active 2026-02-13T02:38:54.671 INFO:teuthology.orchestra.run.trial078.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T02:38:54.672 INFO:teuthology.orchestra.run.trial078.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:38:54.672 INFO:teuthology.orchestra.run.trial078.stdout:Creating mgr... 2026-02-13T02:38:54.673 INFO:teuthology.orchestra.run.trial078.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T02:38:54.673 INFO:teuthology.orchestra.run.trial078.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T02:38:54.897 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.x 2026-02-13T02:38:54.897 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.x.service: Unit ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T02:38:55.089 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460.target.wants/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@.service. 2026-02-13T02:38:55.351 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T02:38:55.352 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout disabled 2026-02-13T02:38:55.362 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T02:38:55.362 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout inactive 2026-02-13T02:38:55.362 INFO:teuthology.orchestra.run.trial078.stdout:firewalld.service is not enabled 2026-02-13T02:38:55.362 INFO:teuthology.orchestra.run.trial078.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T02:38:55.373 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 systemd[1]: Started Ceph mgr.x for 1779b03c-0885-11f1-aeb9-d404e6e7d460. 2026-02-13T02:38:55.376 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T02:38:55.376 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout disabled 2026-02-13T02:38:55.387 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T02:38:55.387 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout inactive 2026-02-13T02:38:55.387 INFO:teuthology.orchestra.run.trial078.stdout:firewalld.service is not enabled 2026-02-13T02:38:55.387 INFO:teuthology.orchestra.run.trial078.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T02:38:55.388 INFO:teuthology.orchestra.run.trial078.stdout:Waiting for mgr to start... 2026-02-13T02:38:55.388 INFO:teuthology.orchestra.run.trial078.stdout:Waiting for mgr... 2026-02-13T02:38:55.628 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:55 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1221063287' entity='client.admin' 2026-02-13T02:38:55.628 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.371+0000 7f0bddbe9fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:38:55.628 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.429+0000 7f0bddbe9fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:38:55.691 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "fsid": "1779b03c-0885-11f1-aeb9-d404e6e7d460", 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 0 2026-02-13T02:38:55.692 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:55.693 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T02:38:52:551729+0000", 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T02:38:52.552257+0000", 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:38:55.694 INFO:teuthology.orchestra.run.trial078.stdout:mgr not available, waiting (1/15)... 2026-02-13T02:38:55.915 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.777+0000 7f0bddbe9fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.788+0000 7f0bddbe9fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.794+0000 7f0bddbe9fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.801+0000 7f0bddbe9fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.807+0000 7f0bddbe9fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.820+0000 7f0bddbe9fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.846+0000 7f0bddbe9fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.850+0000 7f0bddbe9fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.851+0000 7f0bddbe9fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.859+0000 7f0bddbe9fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:38:55.916 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.913+0000 7f0bddbe9fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:38:56.221 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.915+0000 7f0bddbe9fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.920+0000 7f0bddbe9fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.923+0000 7f0bddbe9fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.924+0000 7f0bddbe9fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.927+0000 7f0bddbe9fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.928+0000 7f0bddbe9fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.931+0000 7f0bddbe9fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:55.934+0000 7f0bddbe9fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.219+0000 7f0bddbe9fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:38:56.222 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.219+0000 7f0bddbe9fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:38:56.472 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.222+0000 7f0bddbe9fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:38:56.472 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.225+0000 7f0bddbe9fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.226+0000 7f0bddbe9fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.227+0000 7f0bddbe9fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.227+0000 7f0bddbe9fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.432+0000 7f0bddbe9fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.464+0000 7f0bddbe9fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.468+0000 7f0bddbe9fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.469+0000 7f0bddbe9fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:38:56.473 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:56.470+0000 7f0bddbe9fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:38:56.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/786171628' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T02:38:56.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: Activating manager daemon x 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: mgrmap e2: x(active, starting, since 0.00369148s) 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: Manager daemon x is now available 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' 2026-02-13T02:38:56.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T02:38:56.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:56 trial078 ceph-mon[22944]: from='mgr.14100 10.20.193.78:0/2628658418' entity='mgr.x' 2026-02-13T02:38:58.105 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "fsid": "1779b03c-0885-11f1-aeb9-d404e6e7d460", 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T02:38:58.106 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 0 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:58.107 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T02:38:58.108 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T02:38:52:551729+0000", 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T02:38:58.109 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T02:38:52.552257+0000", 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:38:58.110 INFO:teuthology.orchestra.run.trial078.stdout:mgr is available 2026-02-13T02:38:58.463 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:58.463 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout fsid = 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.78:3300,v1:10.20.193.78:6789] 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout 2026-02-13T02:38:58.464 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T02:38:58.465 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T02:38:58.465 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T02:38:58.465 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T02:38:58.465 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T02:38:58.465 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T02:38:58.465 INFO:teuthology.orchestra.run.trial078.stdout:Enabling cephadm module... 2026-02-13T02:38:58.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:58 trial078 ceph-mon[22944]: mgrmap e3: x(active, since 1.0092s) 2026-02-13T02:38:58.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:58 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4011420016' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T02:38:58.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:58 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/464159278' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T02:38:59.896 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:59 trial078 ceph-mon[22944]: mgrmap e4: x(active, since 2s) 2026-02-13T02:38:59.896 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:38:59 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3502091831' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T02:38:59.897 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: ignoring --setuser ceph since I am not root 2026-02-13T02:38:59.897 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: ignoring --setgroup ceph since I am not root 2026-02-13T02:38:59.897 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.553+0000 7f792b288fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:38:59.897 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.608+0000 7f792b288fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:38:59.977 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:38:59.977 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T02:38:59.977 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T02:38:59.977 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T02:38:59.977 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T02:38:59.977 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:38:59.978 INFO:teuthology.orchestra.run.trial078.stdout:Waiting for the mgr to restart... 2026-02-13T02:38:59.978 INFO:teuthology.orchestra.run.trial078.stdout:Waiting for mgr epoch 5... 2026-02-13T02:39:00.227 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.937+0000 7f792b288fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.947+0000 7f792b288fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.954+0000 7f792b288fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.961+0000 7f792b288fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.967+0000 7f792b288fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:38:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:38:59.979+0000 7f792b288fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.006+0000 7f792b288fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.009+0000 7f792b288fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.011+0000 7f792b288fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:39:00.228 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.018+0000 7f792b288fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.070+0000 7f792b288fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.072+0000 7f792b288fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.077+0000 7f792b288fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.079+0000 7f792b288fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.080+0000 7f792b288fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.083+0000 7f792b288fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.085+0000 7f792b288fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.087+0000 7f792b288fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:39:00.229 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.090+0000 7f792b288fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:39:00.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:00 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3502091831' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T02:39:00.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:00 trial078 ceph-mon[22944]: mgrmap e5: x(active, since 3s) 2026-02-13T02:39:00.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:00 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2430410024' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T02:39:00.729 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.349+0000 7f792b288fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:39:00.729 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.349+0000 7f792b288fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:39:00.729 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.351+0000 7f792b288fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:39:00.729 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.354+0000 7f792b288fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:39:00.729 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.356+0000 7f792b288fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:39:00.729 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.356+0000 7f792b288fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:39:00.730 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.356+0000 7f792b288fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:39:00.730 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.552+0000 7f792b288fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:39:00.730 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.583+0000 7f792b288fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:39:00.730 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.587+0000 7f792b288fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:39:00.730 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.588+0000 7f792b288fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:39:00.730 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:00.589+0000 7f792b288fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:39:01.681 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:39:01.681 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T02:39:01.681 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T02:39:01.681 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:39:01.681 INFO:teuthology.orchestra.run.trial078.stdout:mgr epoch 5 is available 2026-02-13T02:39:01.682 INFO:teuthology.orchestra.run.trial078.stdout:Verifying orchestrator module is enabled... 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: Active manager daemon x restarted 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: Activating manager daemon x 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: mgrmap e6: x(active, starting, since 0.00276186s) 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T02:39:01.743 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: Manager daemon x is now available 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:01.744 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T02:39:01.745 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T02:39:01.745 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:01 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:02.683 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T02:39:02.683 INFO:teuthology.orchestra.run.trial078.stdout:Setting orchestrator backend to cephadm... 2026-02-13T02:39:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:02 trial078 ceph-mon[22944]: Optimize plan auto_2026-02-13_02:39:00, mode upmap, max misplaced 0.050000 2026-02-13T02:39:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:02 trial078 ceph-mon[22944]: No pools available 2026-02-13T02:39:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:02 trial078 ceph-mon[22944]: Found migration_current of "None". Setting to last migration. 2026-02-13T02:39:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:02 trial078 ceph-mon[22944]: mgrmap e7: x(active, since 1.00632s) 2026-02-13T02:39:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:02 trial078 ceph-mon[22944]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T02:39:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:02 trial078 ceph-mon[22944]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T02:39:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:02 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4079300311' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T02:39:03.431 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T02:39:03.431 INFO:teuthology.orchestra.run.trial078.stdout:Generating ssh key... 2026-02-13T02:39:03.864 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4079300311' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T02:39:03.864 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:03 trial078 ceph-mon[22944]: mgrmap e8: x(active, since 2s) 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:03 trial078 ceph-mon[22944]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:03 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:03 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:03 trial078 ceph-mon[22944]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: Generating public/private ed25519 key pair. 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: Your identification has been saved in /tmp/tmpu5jmejs9/key 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: Your public key has been saved in /tmp/tmpu5jmejs9/key.pub 2026-02-13T02:39:03.865 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: The key fingerprint is: 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: SHA256:CA+tXZ3nvtTv7jK1ZDoqfC437MpH0/kx7UpKrx+GK6E ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: The key's randomart image is: 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: +--[ED25519 256]--+ 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | | 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | . . . | 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | o . . o . | 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | * o o | 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | . + S o . .| 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | .+ = =o| 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | ..o.* Xo+| 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | E+.O Xo=.| 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: | oX=Bo=B=| 2026-02-13T02:39:03.866 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: +----[SHA256]-----+ 2026-02-13T02:39:04.192 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2fKz38FfJaDjCUp6HS0WAl80M9kmRhM/eJS0yO+efw ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:04.193 INFO:teuthology.orchestra.run.trial078.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:39:04.193 INFO:teuthology.orchestra.run.trial078.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T02:39:04.194 INFO:teuthology.orchestra.run.trial078.stdout:Adding host trial078... 2026-02-13T02:39:04.992 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:04 trial078 ceph-mon[22944]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:04.993 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:04 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:04.993 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:04 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:04.993 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:04 trial078 ceph-mon[22944]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:04.993 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:04 trial078 ceph-mon[22944]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial078", "addr": "10.20.193.78", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:06.917 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout Added host 'trial078' with addr '10.20.193.78' 2026-02-13T02:39:06.917 INFO:teuthology.orchestra.run.trial078.stdout:Deploying unmanaged mon service... 2026-02-13T02:39:07.314 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T02:39:07.314 INFO:teuthology.orchestra.run.trial078.stdout:Deploying unmanaged mgr service... 2026-02-13T02:39:07.697 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T02:39:07.812 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:07 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:07.812 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:07 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:07.813 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:07 trial078 ceph-mon[22944]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:07.813 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:07 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:07.813 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:07 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:07.813 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:07 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:08.097 INFO:teuthology.orchestra.run.trial078.stdout:Saving cluster configuration to /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/config directory 2026-02-13T02:39:08.563 INFO:teuthology.orchestra.run.trial078.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.564 INFO:teuthology.orchestra.run.trial078.stdout: ceph telemetry on 2026-02-13T02:39:08.565 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.565 INFO:teuthology.orchestra.run.trial078.stdout:For more information see: 2026-02-13T02:39:08.565 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.565 INFO:teuthology.orchestra.run.trial078.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T02:39:08.565 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:08.565 INFO:teuthology.orchestra.run.trial078.stdout:Bootstrap complete. 2026-02-13T02:39:08.578 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout static 2026-02-13T02:39:08.588 INFO:teuthology.orchestra.run.trial078.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T02:39:08.588 INFO:teuthology.orchestra.run.trial078.stdout:systemctl: stdout inactive 2026-02-13T02:39:08.588 INFO:teuthology.orchestra.run.trial078.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T02:39:08.852 INFO:tasks.cephadm:Fetching config... 2026-02-13T02:39:08.852 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:39:08.852 DEBUG:teuthology.orchestra.run.trial078:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T02:39:08.891 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T02:39:08.891 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:39:08.891 DEBUG:teuthology.orchestra.run.trial078:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T02:39:08.971 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T02:39:08.971 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:39:08.971 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T02:39:09.068 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T02:39:09.068 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:39:09.068 DEBUG:teuthology.orchestra.run.trial078:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T02:39:09.148 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T02:39:09.148 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2fKz38FfJaDjCUp6HS0WAl80M9kmRhM/eJS0yO+efw ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T02:39:09.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:09 trial078 ceph-mon[22944]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:09.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:09 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2710536898' entity='client.admin' 2026-02-13T02:39:09.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:09 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:09.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:09 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3873799791' entity='client.admin' 2026-02-13T02:39:09.262 INFO:teuthology.orchestra.run.trial078.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2fKz38FfJaDjCUp6HS0WAl80M9kmRhM/eJS0yO+efw ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:09.284 DEBUG:teuthology.orchestra.run.trial091:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2fKz38FfJaDjCUp6HS0WAl80M9kmRhM/eJS0yO+efw ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T02:39:09.319 INFO:teuthology.orchestra.run.trial091.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2fKz38FfJaDjCUp6HS0WAl80M9kmRhM/eJS0yO+efw ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:09.329 DEBUG:teuthology.orchestra.run.trial154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2fKz38FfJaDjCUp6HS0WAl80M9kmRhM/eJS0yO+efw ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T02:39:09.364 INFO:teuthology.orchestra.run.trial154.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN2fKz38FfJaDjCUp6HS0WAl80M9kmRhM/eJS0yO+efw ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:09.376 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T02:39:09.558 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:10.015 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T02:39:10.015 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T02:39:10.201 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:10.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:10 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:10.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:10 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/419583251' entity='client.admin' 2026-02-13T02:39:10.614 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial091 2026-02-13T02:39:10.614 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:39:10.614 DEBUG:teuthology.orchestra.run.trial091:> dd of=/etc/ceph/ceph.conf 2026-02-13T02:39:10.632 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:39:10.632 DEBUG:teuthology.orchestra.run.trial091:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:39:10.688 INFO:tasks.cephadm:Adding host trial091 to orchestrator... 2026-02-13T02:39:10.688 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch host add trial091 2026-02-13T02:39:10.874 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:11.655 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:11 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:11.655 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:11 trial078 ceph-mon[22944]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:11.655 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:11 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:12.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial091", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:12.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:12 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:13.034 INFO:teuthology.orchestra.run.trial078.stdout:Added host 'trial091' with addr '10.20.193.91' 2026-02-13T02:39:13.142 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T02:39:13.327 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:13.638 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:13.639 INFO:teuthology.orchestra.run.trial078.stdout:[{"addr": "10.20.193.78", "hostname": "trial078", "labels": [], "status": ""}, {"addr": "10.20.193.91", "hostname": "trial091", "labels": [], "status": ""}] 2026-02-13T02:39:13.778 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial154 2026-02-13T02:39:13.778 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:39:13.778 DEBUG:teuthology.orchestra.run.trial154:> dd of=/etc/ceph/ceph.conf 2026-02-13T02:39:13.797 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:39:13.797 DEBUG:teuthology.orchestra.run.trial154:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:39:13.853 INFO:tasks.cephadm:Adding host trial154 to orchestrator... 2026-02-13T02:39:13.853 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch host add trial154 2026-02-13T02:39:14.037 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:14.157 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:14 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:14.157 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:14 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:14.157 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:14 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:14.157 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:14 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:14.157 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:14 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:14.157 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:14 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:15.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:15 trial078 ceph-mon[22944]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:39:15.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:15 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:15.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:15 trial078 ceph-mon[22944]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial154", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:15.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:15 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.192 INFO:teuthology.orchestra.run.trial078.stdout:Added host 'trial154' with addr '10.20.193.154' 2026-02-13T02:39:16.301 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T02:39:16.486 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:16.798 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:16.799 INFO:teuthology.orchestra.run.trial078.stdout:[{"addr": "10.20.193.78", "hostname": "trial078", "labels": [], "status": ""}, {"addr": "10.20.193.91", "hostname": "trial091", "labels": [], "status": ""}, {"addr": "10.20.193.154", "hostname": "trial154", "labels": [], "status": ""}] 2026-02-13T02:39:16.799 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.799 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.799 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.799 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.799 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:16.799 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:16.799 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:16.800 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.800 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.800 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.800 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.800 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:16.800 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:16 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:16.900 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T02:39:16.901 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T02:39:17.084 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:17.828 INFO:teuthology.orchestra.run.trial078.stderr:adjusted tunables profile to default 2026-02-13T02:39:17.931 INFO:tasks.cephadm:Adding mon.a on trial078 2026-02-13T02:39:17.931 INFO:tasks.cephadm:Adding mon.b on trial091 2026-02-13T02:39:17.931 INFO:tasks.cephadm:Adding mon.c on trial154 2026-02-13T02:39:17.931 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch apply mon '3;trial078:10.20.193.78=a;trial091:10.20.193.91=b;trial154:10.20.193.154=c' 2026-02-13T02:39:18.051 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:39:18.051 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:39:18.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:17 trial078 ceph-mon[22944]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:39:18.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:17 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:18.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:17 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2868038906' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T02:39:18.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:17 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:18.279 INFO:teuthology.orchestra.run.trial154.stdout:Scheduled mon update... 2026-02-13T02:39:18.319 DEBUG:teuthology.orchestra.run.trial091:mon.b> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.b.service 2026-02-13T02:39:18.322 DEBUG:teuthology.orchestra.run.trial154:mon.c> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.c.service 2026-02-13T02:39:18.324 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T02:39:18.324 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T02:39:18.488 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:39:18.488 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:39:18.743 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:39:18.743 INFO:teuthology.orchestra.run.trial154.stdout:{"epoch":1,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","modified":"2026-02-13T02:38:50.887077Z","created":"2026-02-13T02:38:50.887077Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:3300","nonce":0},{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:38:50:887100+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T02:39:18.744 INFO:teuthology.orchestra.run.trial154.stderr:dumped monmap epoch 1 2026-02-13T02:39:19.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2868038906' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial078:10.20.193.78=a;trial091:10.20.193.91=b;trial154:10.20.193.154=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:19.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:19.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:18 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/4206961628' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:39:19.786 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T02:39:19.787 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T02:39:20.002 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:39:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:19 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:19 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:19 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:19 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:19 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:20 trial154 ceph-mon[27921]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T02:39:25.244 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:39:25.244 INFO:teuthology.orchestra.run.trial154.stdout:{"epoch":2,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","modified":"2026-02-13T02:39:20.234517Z","created":"2026-02-13T02:38:50.887077Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:3300","nonce":0},{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:38:50:887100+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:3300","nonce":0},{"type":"v1","addr":"10.20.193.154:6789","nonce":0}]},"addr":"10.20.193.154:6789/0","public_addr":"10.20.193.154:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:39:20:234515+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T02:39:25.244 INFO:teuthology.orchestra.run.trial154.stderr:dumped monmap epoch 2 2026-02-13T02:39:25.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:25.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: mon.a calling monitor election 2026-02-13T02:39:25.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/1215429096' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:39:25.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:25.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: mon.c calling monitor election 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: monmap epoch 2 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: last_changed 2026-02-13T02:39:20.234517+0000 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: created 2026-02-13T02:38:50.887077+0000 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: min_mon_release 20 (tentacle) 2026-02-13T02:39:25.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: election_strategy: 1 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: 0: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.a 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: fsmap 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: mgrmap e8: x(active, since 24s) 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: overall HEALTH_OK 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:25.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:25 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:25.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: mon.a calling monitor election 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/1215429096' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: mon.c calling monitor election 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: monmap epoch 2 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: last_changed 2026-02-13T02:39:20.234517+0000 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: created 2026-02-13T02:38:50.887077+0000 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: min_mon_release 20 (tentacle) 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: election_strategy: 1 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: 0: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.a 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: fsmap 2026-02-13T02:39:25.729 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:39:25.730 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: mgrmap e8: x(active, since 24s) 2026-02-13T02:39:25.730 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: overall HEALTH_OK 2026-02-13T02:39:25.730 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:25.730 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:25.730 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:25.730 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:25.730 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:25 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:26.289 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T02:39:26.290 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T02:39:26.409 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:39:26.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:26 trial091 ceph-mon[27614]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T02:39:26.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:26 trial078 ceph-mon[22944]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:26.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:26 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:26.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:26 trial154 ceph-mon[27921]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:26.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:26 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:27.727 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:27 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:27.234+0000 7f78d54206c0 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-13T02:39:31.564 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:39:31.565 INFO:teuthology.orchestra.run.trial154.stdout:{"epoch":3,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","modified":"2026-02-13T02:39:26.553360Z","created":"2026-02-13T02:38:50.887077Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:3300","nonce":0},{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:38:50:887100+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:3300","nonce":0},{"type":"v1","addr":"10.20.193.154:6789","nonce":0}]},"addr":"10.20.193.154:6789/0","public_addr":"10.20.193.154:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:39:20:234515+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:3300","nonce":0},{"type":"v1","addr":"10.20.193.91:6789","nonce":0}]},"addr":"10.20.193.91:6789/0","public_addr":"10.20.193.91:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:39:26:553358+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T02:39:31.565 INFO:teuthology.orchestra.run.trial154.stderr:dumped monmap epoch 3 2026-02-13T02:39:31.605 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T02:39:31.605 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T02:39:31.789 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:31.882 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:31.882 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.882 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:31.882 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: mon.c calling monitor election 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: mon.a calling monitor election 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: mon.b calling monitor election 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/3016121190' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.883 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: monmap epoch 3 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: last_changed 2026-02-13T02:39:26.553360+0000 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: created 2026-02-13T02:38:50.887077+0000 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: min_mon_release 20 (tentacle) 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: election_strategy: 1 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: 0: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.a 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: 2: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.b 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: fsmap 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:39:31.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: mgrmap e8: x(active, since 30s) 2026-02-13T02:39:31.885 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: overall HEALTH_OK 2026-02-13T02:39:31.885 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.885 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.885 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.885 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:31 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: mon.c calling monitor election 2026-02-13T02:39:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: mon.a calling monitor election 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: mon.b calling monitor election 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/3016121190' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: monmap epoch 3 2026-02-13T02:39:31.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: last_changed 2026-02-13T02:39:26.553360+0000 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: created 2026-02-13T02:38:50.887077+0000 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: min_mon_release 20 (tentacle) 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: election_strategy: 1 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: 0: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.a 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: 2: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.b 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: fsmap 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: mgrmap e8: x(active, since 30s) 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: overall HEALTH_OK 2026-02-13T02:39:31.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:31 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.994 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:31.994 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.994 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:31.994 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: mon.c calling monitor election 2026-02-13T02:39:31.994 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: mon.a calling monitor election 2026-02-13T02:39:31.994 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: mon.b calling monitor election 2026-02-13T02:39:31.994 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/3016121190' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: monmap epoch 3 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:31.995 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: last_changed 2026-02-13T02:39:26.553360+0000 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: created 2026-02-13T02:38:50.887077+0000 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: min_mon_release 20 (tentacle) 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: election_strategy: 1 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: 0: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.a 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: 2: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.b 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: fsmap 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: mgrmap e8: x(active, since 30s) 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: overall HEALTH_OK 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.996 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:31.997 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:31 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.101 INFO:teuthology.orchestra.run.trial078.stdout:# minimal ceph.conf for 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:32.101 INFO:teuthology.orchestra.run.trial078.stdout:[global] 2026-02-13T02:39:32.101 INFO:teuthology.orchestra.run.trial078.stdout: fsid = 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:39:32.101 INFO:teuthology.orchestra.run.trial078.stdout: mon_host = [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] 2026-02-13T02:39:32.209 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T02:39:32.210 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:39:32.210 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T02:39:32.264 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:39:32.264 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:39:32.358 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:39:32.359 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T02:39:32.386 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:39:32.386 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:39:32.450 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:39:32.450 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T02:39:32.478 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:39:32.478 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:39:32.542 INFO:tasks.cephadm:enabling module snap_schedule 2026-02-13T02:39:32.542 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1191286149' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:32 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:32.722 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:32.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:32.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1191286149' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:32.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:32 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:32.855 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:32.855 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1191286149' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:32.855 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.855 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.855 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.855 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.856 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:32.856 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:32.856 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.856 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.856 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.856 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:32.856 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:32 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:33.788 INFO:tasks.cephadm:Adding mgr.x on trial078 2026-02-13T02:39:33.788 INFO:tasks.cephadm:Adding mgr.y on trial091 2026-02-13T02:39:33.789 INFO:tasks.cephadm:Adding mgr.z on trial154 2026-02-13T02:39:33.789 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch apply mgr '3;trial078=x;trial091=y;trial154=z' 2026-02-13T02:39:33.823 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:33 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:33.553+0000 7f78d54206c0 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-13T02:39:33.823 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:33 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: ignoring --setuser ceph since I am not root 2026-02-13T02:39:33.823 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:33 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: ignoring --setgroup ceph since I am not root 2026-02-13T02:39:33.823 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:33 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:33.765+0000 7f0584d3dfc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:39:33.823 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:33 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:33.820+0000 7f0584d3dfc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:39:33.823 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:33.823 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2832910025' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:33.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:33.825 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:33 trial078 ceph-mon[22944]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:33.903 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:39:33.926 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2832910025' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:33.927 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:33.928 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:33 trial154 ceph-mon[27921]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:33.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:33.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2832910025' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:33.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:33 trial091 ceph-mon[27614]: from='mgr.14116 10.20.193.78:0/1833818135' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:34.478 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.142+0000 7f0584d3dfc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:39:34.478 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.152+0000 7f0584d3dfc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:39:34.478 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.159+0000 7f0584d3dfc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:39:34.478 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.165+0000 7f0584d3dfc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:39:34.478 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.171+0000 7f0584d3dfc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:39:34.478 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.184+0000 7f0584d3dfc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:39:34.478 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.209+0000 7f0584d3dfc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.213+0000 7f0584d3dfc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.215+0000 7f0584d3dfc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.222+0000 7f0584d3dfc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.272+0000 7f0584d3dfc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.274+0000 7f0584d3dfc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.279+0000 7f0584d3dfc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.281+0000 7f0584d3dfc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.282+0000 7f0584d3dfc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.286+0000 7f0584d3dfc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.287+0000 7f0584d3dfc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.289+0000 7f0584d3dfc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:39:34.479 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.292+0000 7f0584d3dfc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:39:34.816 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:34 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2832910025' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T02:39:34.816 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:34 trial078 ceph-mon[22944]: mgrmap e9: x(active, since 33s) 2026-02-13T02:39:34.816 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.547+0000 7f0584d3dfc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.547+0000 7f0584d3dfc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.549+0000 7f0584d3dfc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.552+0000 7f0584d3dfc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.554+0000 7f0584d3dfc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.554+0000 7f0584d3dfc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.554+0000 7f0584d3dfc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.749+0000 7f0584d3dfc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.780+0000 7f0584d3dfc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.784+0000 7f0584d3dfc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.785+0000 7f0584d3dfc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:39:34.817 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:39:34.786+0000 7f0584d3dfc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:39:34.818 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:345: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T02:39:34.818 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: tz = given_cert.not_valid_after.tzinfo 2026-02-13T02:39:34.818 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:346: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T02:39:34.818 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:39:34 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: if datetime.now(tz) >= given_cert.not_valid_after: 2026-02-13T02:39:34.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:34 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2832910025' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T02:39:34.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:34 trial091 ceph-mon[27614]: mgrmap e9: x(active, since 33s) 2026-02-13T02:39:35.005 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:34 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2832910025' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T02:39:35.005 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:34 trial154 ceph-mon[27921]: mgrmap e9: x(active, since 33s) 2026-02-13T02:39:35.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: Active manager daemon x restarted 2026-02-13T02:39:35.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: Activating manager daemon x 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: mgrmap e10: x(active, starting, since 0.00373715s) 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T02:39:35.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: Manager daemon x is now available 2026-02-13T02:39:35.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:35.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T02:39:35.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T02:39:35.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: Active manager daemon x restarted 2026-02-13T02:39:35.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: Activating manager daemon x 2026-02-13T02:39:35.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: mgrmap e10: x(active, starting, since 0.00373715s) 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: Manager daemon x is now available 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T02:39:35.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T02:39:35.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.804 INFO:teuthology.orchestra.run.trial154.stdout:Scheduled mgr update... 2026-02-13T02:39:35.867 DEBUG:teuthology.orchestra.run.trial091:mgr.y> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.y.service 2026-02-13T02:39:35.870 DEBUG:teuthology.orchestra.run.trial154:mgr.z> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.z.service 2026-02-13T02:39:35.872 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T02:39:35.873 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T02:39:35.877 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T02:39:35.877 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T02:39:35.921 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T02:39:35.921 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T02:39:35.922 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: Active manager daemon x restarted 2026-02-13T02:39:35.922 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: Activating manager daemon x 2026-02-13T02:39:35.922 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T02:39:35.922 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: mgrmap e10: x(active, starting, since 0.00373715s) 2026-02-13T02:39:35.922 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:39:35.922 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: Manager daemon x is now available 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.923 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.924 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.924 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:35.966 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T02:39:35.966 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T02:39:36.010 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T02:39:36.011 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T02:39:36.064 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.107 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T02:39:36.107 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T02:39:36.111 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.157 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T02:39:36.158 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T02:39:36.164 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.168 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T02:39:36.168 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T02:39:36.214 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T02:39:36.214 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T02:39:36.215 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.266 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T02:39:36.267 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T02:39:36.315 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T02:39:36.315 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T02:39:36.368 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T02:39:36.368 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T02:39:36.369 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.420 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T02:39:36.420 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T02:39:36.444 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.450 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T02:39:36.451 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T02:39:36.451 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.502 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T02:39:36.502 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T02:39:36.566 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T02:39:36.566 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T02:39:36.583 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.588 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T02:39:36.588 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T02:39:36.643 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T02:39:36.643 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T02:39:36.688 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T02:39:36.688 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T02:39:36.741 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T02:39:36.741 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T02:39:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.753+0000 7fe6fb7fe6c0 1 -- 10.20.193.78:0/847758153 <== mon.1 v2:10.20.193.154:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v11)=0 v11) ==== 109+0+0 (secure 0 0 0) 0x7fe700034880 con 0x7fe70c114300 2026-02-13T02:39:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.755+0000 7fe6f97fa6c0 1 -- 10.20.193.78:0/847758153 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe6e403f880 msgr2=0x7fe6e405fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 --2- 10.20.193.78:0/847758153 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe6e403f880 0x7fe6e405fd30 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6fc006fd0 tx=0x7fe6fc00a5a0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 -- 10.20.193.78:0/847758153 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe70c114300 msgr2=0x7fe70c0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 --2- 10.20.193.78:0/847758153 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe70c114300 0x7fe70c0ff670 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe70002f740 tx=0x7fe7000045f0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 -- 10.20.193.78:0/847758153 shutdown_connections 2026-02-13T02:39:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 --2- 10.20.193.78:0/847758153 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe6e403f880 0x7fe6e405fd30 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 --2- 10.20.193.78:0/847758153 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe70c1571c0 0x7fe70c100210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 --2- 10.20.193.78:0/847758153 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe70c114300 0x7fe70c0ff670 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 --2- 10.20.193.78:0/847758153 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe70c05e610 0x7fe70c0ff020 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 -- 10.20.193.78:0/847758153 >> 10.20.193.78:0/847758153 conn(0x7fe70c05b720 msgr2=0x7fe70c0f5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 -- 10.20.193.78:0/847758153 shutdown_connections 2026-02-13T02:39:36.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.756+0000 7fe6f97fa6c0 1 -- 10.20.193.78:0/847758153 wait complete. 2026-02-13T02:39:36.780 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2026-02-13T02:39:36.780 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr debug_cephsqlite 20 2026-02-13T02:39:36.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.808+0000 7fd4d4a206c0 1 -- 10.20.193.78:0/2272815689 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd49c002e50 con 0x7fd4d0114350 2026-02-13T02:39:36.814 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T02:39:36.814 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T02:39:36.815 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.812+0000 7fd4b7fff6c0 1 -- 10.20.193.78:0/2272815689 <== mon.0 v2:10.20.193.78:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fd4b8013530 con 0x7fd4d0114350 2026-02-13T02:39:36.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.812+0000 7fd4b7fff6c0 1 -- 10.20.193.78:0/2272815689 <== mon.0 v2:10.20.193.78:3300/0 10 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fd4b8024510 con 0x7fd4d0114350 2026-02-13T02:39:36.834 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T02:39:36.834 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T02:39:36.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 -- 10.20.193.78:0/3536995069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 msgr2=0x7f51a01341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 --2- 10.20.193.78:0/3536995069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 0x7f51a01341a0 secure :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=6331679184043179635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51900075a0 tx=0x7f519002fe80 comp rx=0 tx=0).stop 2026-02-13T02:39:36.835 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 -- 10.20.193.78:0/3536995069 shutdown_connections 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 --2- 10.20.193.78:0/3536995069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51a0155310 0x7f51a01757c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 --2- 10.20.193.78:0/3536995069 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f51a0134770 0x7f51a0154bd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 --2- 10.20.193.78:0/3536995069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 0x7f51a01341a0 unknown :-1 s=CLOSED pgs=8 gs=2 cs=0 l=1 c_cookie=6331679184043179635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 -- 10.20.193.78:0/3536995069 >> 10.20.193.78:0/3536995069 conn(0x7f51a005b700 msgr2=0x7f51a005bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.822+0000 7f51a80496c0 1 -- 10.20.193.78:0/3536995069 shutdown_connections 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.823+0000 7f51a80496c0 1 -- 10.20.193.78:0/3536995069 wait complete. 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.824+0000 7f51a80496c0 1 Processor -- start 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.824+0000 7f51a80496c0 1 -- start start 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.824+0000 7f51a80496c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 0x7f51a0154bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.824+0000 7f51a80496c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51a0134770 0x7f51a01757a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.836 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a80496c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f51a0155310 0x7f51a0102620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a80496c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0102db0 con 0x7f51a0155310 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a80496c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0102f20 con 0x7f51a0113dc0 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a80496c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51a0103560 con 0x7f51a0134770 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a5dba6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 0x7f51a0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a5dba6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 0x7f51a0154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37386/0 (socket says 10.20.193.78:37386) 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a5dba6c0 1 -- 10.20.193.78:0/815848255 learned_addr learned my addr 10.20.193.78:0/815848255 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a6dbc6c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f51a0155310 0x7f51a0102620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a55b96c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51a0134770 0x7f51a01757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a6dbc6c0 1 -- 10.20.193.78:0/815848255 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51a0134770 msgr2=0x7f51a01757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a6dbc6c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51a0134770 0x7f51a01757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a6dbc6c0 1 -- 10.20.193.78:0/815848255 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 msgr2=0x7f51a0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a6dbc6c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 0x7f51a0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a6dbc6c0 1 -- 10.20.193.78:0/815848255 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51900071c0 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a55b96c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51a0134770 0x7f51a01757a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.825+0000 7f51a6dbc6c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f51a0155310 0x7f51a0102620 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5198006fd0 tx=0x7f519800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.826+0000 7f518effd6c0 1 -- 10.20.193.78:0/815848255 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51980054a0 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.826+0000 7f518effd6c0 1 -- 10.20.193.78:0/815848255 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f519800a030 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.826+0000 7f518effd6c0 1 -- 10.20.193.78:0/815848255 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f519800ddf0 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.826+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a0103840 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.826+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a0103ca0 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.827+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a017b860 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.829+0000 7f518effd6c0 1 -- 10.20.193.78:0/815848255 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f519800d4d0 con 0x7f51a0155310 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.829+0000 7f518effd6c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f517c03f7a0 0x7f517c05fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.830+0000 7f518effd6c0 1 -- 10.20.193.78:0/815848255 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f519800f070 con 0x7f51a0155310 2026-02-13T02:39:36.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.830+0000 7f51a5dba6c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f517c03f7a0 0x7f517c05fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:36.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.830+0000 7f518effd6c0 1 -- 10.20.193.78:0/815848255 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5198005cb0 con 0x7f51a0155310 2026-02-13T02:39:36.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.831+0000 7f51a5dba6c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f517c03f7a0 0x7f517c05fc50 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5190005980 tx=0x7f5190005ac0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:36.839 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.846 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T02:39:36.846 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T02:39:36.852 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.876 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2026-02-13T02:39:36.876 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2026-02-13T02:39:36.877 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.866+0000 7fc0212616c0 1 -- 10.20.193.78:0/2851356136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 msgr2=0x7fc01c175990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.866+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2851356136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c175990 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=597291409255976093 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc00c00aa40 tx=0x7fc00c02fe00 comp rx=0 tx=0).stop 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.866+0000 7fc0212616c0 1 -- 10.20.193.78:0/2851356136 shutdown_connections 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.866+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2851356136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c175990 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=597291409255976093 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.867+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2851356136 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01c134920 0x7fc01c154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.867+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2851356136 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc01c113f70 0x7fc01c134350 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.867+0000 7fc0212616c0 1 -- 10.20.193.78:0/2851356136 >> 10.20.193.78:0/2851356136 conn(0x7fc01c05b8e0 msgr2=0x7fc01c05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:36.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.867+0000 7fc0212616c0 1 -- 10.20.193.78:0/2851356136 shutdown_connections 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.867+0000 7fc0212616c0 1 -- 10.20.193.78:0/2851356136 wait complete. 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.868+0000 7fc0212616c0 1 Processor -- start 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.868+0000 7fc0212616c0 1 -- start start 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc0212616c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01c113f70 0x7fc01c154d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc0212616c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc01c134920 0x7fc01c175910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc0212616c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c0fb6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc0212616c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c0f9e20 con 0x7fc01c113f70 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc0212616c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c0f9f90 con 0x7fc01c1554e0 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc0212616c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c0fa150 con 0x7fc01c134920 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc01b5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c0fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc01b5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c0fb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37406/0 (socket says 10.20.193.78:37406) 2026-02-13T02:39:36.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc01b5776c0 1 -- 10.20.193.78:0/2698507492 learned_addr learned my addr 10.20.193.78:0/2698507492 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.869+0000 7fc01a5756c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc01c134920 0x7fc01c175910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fc01b5776c0 1 -- 10.20.193.78:0/2698507492 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc01c134920 msgr2=0x7fc01c175910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fc01b5776c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc01c134920 0x7fc01c175910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fc01b5776c0 1 -- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01c113f70 msgr2=0x7fc01c154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fc01b5776c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01c113f70 0x7fc01c154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fc01b5776c0 1 -- 10.20.193.78:0/2698507492 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c00a660 con 0x7fc01c1554e0 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fc01b5776c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c0fb6f0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc00c030310 tx=0x7fc00c003810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc00c003a00 con 0x7fc01c1554e0 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01c0fa3d0 con 0x7fc01c1554e0 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.870+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fc00c003b60 con 0x7fc01c1554e0 2026-02-13T02:39:36.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.871+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc00c008800 con 0x7fc01c1554e0 2026-02-13T02:39:36.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.871+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01c0fa8d0 con 0x7fc01c1554e0 2026-02-13T02:39:36.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.872+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fc00c0089d0 con 0x7fc01c1554e0 2026-02-13T02:39:36.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.872+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01c179cf0 con 0x7fc01c1554e0 2026-02-13T02:39:36.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.873+0000 7fbffbfff6c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbff403f820 0x7fbff405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:36.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.873+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc00c0767f0 con 0x7fc01c1554e0 2026-02-13T02:39:36.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.876+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc00c032730 con 0x7fc01c1554e0 2026-02-13T02:39:36.893 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2026-02-13T02:39:36.893 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 -- 10.20.193.78:0/2272815689 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd49803f820 msgr2=0x7fd49805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 --2- 10.20.193.78:0/2272815689 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd49803f820 0x7fd49805fcd0 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4c40098c0 tx=0x7fd4c4005c60 comp rx=0 tx=0).stop 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 -- 10.20.193.78:0/2272815689 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd4d0114350 msgr2=0x7fd4d00ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 --2- 10.20.193.78:0/2272815689 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd4d0114350 0x7fd4d00ff910 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4b800b750 tx=0x7fd4b800bc20 comp rx=0 tx=0).stop 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 -- 10.20.193.78:0/2272815689 shutdown_connections 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 --2- 10.20.193.78:0/2272815689 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd49803f820 0x7fd49805fcd0 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 --2- 10.20.193.78:0/2272815689 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd4d0114ee0 0x7fd4d0100500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 --2- 10.20.193.78:0/2272815689 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd4d0114350 0x7fd4d00ff910 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 --2- 10.20.193.78:0/2272815689 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd4d005e400 0x7fd4d00ff2c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:36.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 -- 10.20.193.78:0/2272815689 >> 10.20.193.78:0/2272815689 conn(0x7fd4d005b720 msgr2=0x7fd4d00f5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:36.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.856+0000 7fd4d4a206c0 1 -- 10.20.193.78:0/2272815689 shutdown_connections 2026-02-13T02:39:36.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.857+0000 7fd4d4a206c0 1 -- 10.20.193.78:0/2272815689 wait complete. 2026-02-13T02:39:36.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.880+0000 7fc01ad766c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbff403f820 0x7fbff405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:36.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:36.887+0000 7fc01ad766c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbff403f820 0x7fbff405fcd0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc010004770 tx=0x7fc010006d00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:36.927 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2026-02-13T02:39:36.927 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/log_level debug 2026-02-13T02:39:36.957 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:36.971 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T02:39:36.971 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: Optimize plan auto_2026-02-13_02:39:34, mode upmap, max misplaced 0.050000 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: No pools available 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: mgrmap e11: x(active, since 1.00896s) 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial078=x;trial091=y;trial154=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:36.996 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:36.997 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:36.997 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:36.997 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:36.997 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:36.997 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1780401242' entity='client.admin' 2026-02-13T02:39:36.997 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:36.997 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:36 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:37.001 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T02:39:37.002 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T02:39:37.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.004+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f51a00589a0 con 0x7f51a0155310 2026-02-13T02:39:37.031 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T02:39:37.031 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T02:39:37.057 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.120 DEBUG:tasks.cephadm:set 30 configs 2026-02-13T02:39:37.121 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.121 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.121 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.075+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fbfe80051e0 con 0x7fc01c1554e0 2026-02-13T02:39:37.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.082+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc00c032730 con 0x7fc01c1554e0 2026-02-13T02:39:37.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.082+0000 7fbffbfff6c0 1 -- 10.20.193.78:0/2698507492 <== mon.2 v2:10.20.193.91:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fc00c006ce0 con 0x7fc01c1554e0 2026-02-13T02:39:37.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbff403f820 msgr2=0x7fbff405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbff403f820 0x7fbff405fcd0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc010004770 tx=0x7fc010006d00 comp rx=0 tx=0).stop 2026-02-13T02:39:37.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 msgr2=0x7fc01c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c0fb6f0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc00c030310 tx=0x7fc00c003810 comp rx=0 tx=0).stop 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 shutdown_connections 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbff403f820 0x7fbff405fcd0 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc01c1554e0 0x7fc01c0fb6f0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc01c134920 0x7fc01c175910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 --2- 10.20.193.78:0/2698507492 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01c113f70 0x7fc01c154d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 >> 10.20.193.78:0/2698507492 conn(0x7fc01c05b8e0 msgr2=0x7fc01c0f5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 shutdown_connections 2026-02-13T02:39:37.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.086+0000 7fc0212616c0 1 -- 10.20.193.78:0/2698507492 wait complete. 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.058+0000 7f518effd6c0 1 -- 10.20.193.78:0/815848255 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v13)=0 v13) ==== 108+0+0 (secure 0 0 0) 0x7f5198012750 con 0x7f51a0155310 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f517c03f7a0 msgr2=0x7f517c05fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f517c03f7a0 0x7f517c05fc50 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5190005980 tx=0x7f5190005ac0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f51a0155310 msgr2=0x7f51a0102620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f51a0155310 0x7f51a0102620 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5198006fd0 tx=0x7f519800cc20 comp rx=0 tx=0).stop 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 shutdown_connections 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f517c03f7a0 0x7f517c05fc50 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f51a0155310 0x7f51a0102620 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51a0134770 0x7f51a01757a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 --2- 10.20.193.78:0/815848255 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51a0113dc0 0x7f51a0154bd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 >> 10.20.193.78:0/815848255 conn(0x7f51a005b700 msgr2=0x7f51a017c260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 shutdown_connections 2026-02-13T02:39:37.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.062+0000 7f51a80496c0 1 -- 10.20.193.78:0/815848255 wait complete. 2026-02-13T02:39:37.125 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.172 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.172 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.181+0000 7f7d95d376c0 1 -- 10.20.193.78:0/2931419234 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 msgr2=0x7f7d90171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.181+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/2931419234 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 0x7f7d90171380 secure :-1 s=READY pgs=8 gs=2 cs=0 l=1 c_cookie=18027395694470555704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d7c009970 tx=0x7f7d7c02ed10 comp rx=0 tx=0).stop 2026-02-13T02:39:37.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.182+0000 7f7d95d376c0 1 -- 10.20.193.78:0/2931419234 shutdown_connections 2026-02-13T02:39:37.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.182+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/2931419234 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 0x7f7d90171380 unknown :-1 s=CLOSED pgs=8 gs=2 cs=0 l=1 c_cookie=18027395694470555704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.182+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/2931419234 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d90110040 0x7f7d901104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.182+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/2931419234 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7d9010eec0 0x7f7d9010f2b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.182+0000 7f7d95d376c0 1 -- 10.20.193.78:0/2931419234 >> 10.20.193.78:0/2931419234 conn(0x7f7d900ec5e0 msgr2=0x7f7d9010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.182+0000 7f7d95d376c0 1 -- 10.20.193.78:0/2931419234 shutdown_connections 2026-02-13T02:39:37.185 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.182+0000 7f7d95d376c0 1 -- 10.20.193.78:0/2931419234 wait complete. 2026-02-13T02:39:37.186 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.184+0000 7f7d95d376c0 1 Processor -- start 2026-02-13T02:39:37.188 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.186+0000 7f7d95d376c0 1 -- start start 2026-02-13T02:39:37.190 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.192 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.190+0000 7f7d95d376c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d9010eec0 0x7f7d900f84d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.193+0000 7f7d95d376c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7d90110040 0x7f7d90171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: Optimize plan auto_2026-02-13_02:39:34, mode upmap, max misplaced 0.050000 2026-02-13T02:39:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: No pools available 2026-02-13T02:39:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: mgrmap e11: x(active, since 1.00896s) 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial078=x;trial091=y;trial154=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1780401242' entity='client.admin' 2026-02-13T02:39:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:37.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:36 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:37.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.193+0000 7f7d95d376c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 0x7f7d900f8d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.193+0000 7f7d8f7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d9010eec0 0x7f7d900f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.193+0000 7f7d8f7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d9010eec0 0x7f7d900f84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47310/0 (socket says 10.20.193.78:47310) 2026-02-13T02:39:37.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.194+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7d900f9960 con 0x7f7d9010eec0 2026-02-13T02:39:37.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.194+0000 7f7d8f7fe6c0 1 -- 10.20.193.78:0/1292506834 learned_addr learned my addr 10.20.193.78:0/1292506834 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8ffff6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 0x7f7d900f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.206 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7d900f9ad0 con 0x7f7d90110040 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d900f9c90 con 0x7f7d901109f0 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8effd6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7d90110040 0x7f7d90171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8f7fe6c0 1 -- 10.20.193.78:0/1292506834 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 msgr2=0x7f7d900f8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8f7fe6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 0x7f7d900f8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8f7fe6c0 1 -- 10.20.193.78:0/1292506834 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7d90110040 msgr2=0x7f7d90171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8f7fe6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7d90110040 0x7f7d90171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8f7fe6c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7c009590 con 0x7f7d9010eec0 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.195+0000 7f7d8f7fe6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d9010eec0 0x7f7d900f84d0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d80009490 tx=0x7f7d8000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.196+0000 7f7d8ffff6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 0x7f7d900f8d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.196+0000 7f7d8cff96c0 1 -- 10.20.193.78:0/1292506834 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d80004a80 con 0x7f7d9010eec0 2026-02-13T02:39:37.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.196+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d900f9f70 con 0x7f7d9010eec0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.196+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d900fa440 con 0x7f7d9010eec0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.196+0000 7f7d8cff96c0 1 -- 10.20.193.78:0/1292506834 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7d80009030 con 0x7f7d9010eec0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.196+0000 7f7d8cff96c0 1 -- 10.20.193.78:0/1292506834 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d80004a80 con 0x7f7d9010eec0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.197+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d90175410 con 0x7f7d9010eec0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.198+0000 7f7d8cff96c0 1 -- 10.20.193.78:0/1292506834 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f7d80005440 con 0x7f7d9010eec0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.198+0000 7f7d8cff96c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7d64048290 0x7f7d64068740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.199+0000 7f7d8cff96c0 1 -- 10.20.193.78:0/1292506834 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f7d800243a0 con 0x7f7d9010eec0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.199+0000 7f7d8effd6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7d64048290 0x7f7d64068740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.200+0000 7f7d8cff96c0 1 -- 10.20.193.78:0/1292506834 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7d8000cad0 con 0x7f7d9010eec0 2026-02-13T02:39:37.214 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.209+0000 7f7d8effd6c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7d64048290 0x7f7d64068740 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d84007fd0 tx=0x7f7d84007e80 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 -- 10.20.193.78:0/2704768407 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 msgr2=0x7f2040118e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 --2- 10.20.193.78:0/2704768407 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040118e90 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=14314218879137305167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f202c009970 tx=0x7f202c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 -- 10.20.193.78:0/2704768407 shutdown_connections 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 --2- 10.20.193.78:0/2704768407 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f20401193d0 0x7f2040179d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 --2- 10.20.193.78:0/2704768407 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040118e90 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=14314218879137305167 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 --2- 10.20.193.78:0/2704768407 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20401178a0 0x7f2040117c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 -- 10.20.193.78:0/2704768407 >> 10.20.193.78:0/2704768407 conn(0x7f20400f4fc0 msgr2=0x7f20401153d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 -- 10.20.193.78:0/2704768407 shutdown_connections 2026-02-13T02:39:37.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.251+0000 7f20471446c0 1 -- 10.20.193.78:0/2704768407 wait complete. 2026-02-13T02:39:37.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.253+0000 7f20471446c0 1 Processor -- start 2026-02-13T02:39:37.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.253+0000 7f20471446c0 1 -- start start 2026-02-13T02:39:37.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f20471446c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20401178a0 0x7f2040123010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f20471446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040123660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f20471446c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f20401193d0 0x7f2040124250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f20471446c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f20401249e0 con 0x7f20401193d0 2026-02-13T02:39:37.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f20471446c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2040124b50 con 0x7f20401178a0 2026-02-13T02:39:37.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f20471446c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2040124d10 con 0x7f2040118a20 2026-02-13T02:39:37.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f203ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040123660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f203ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040123660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49818/0 (socket says 10.20.193.78:49818) 2026-02-13T02:39:37.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f203ffff6c0 1 -- 10.20.193.78:0/2888246345 learned_addr learned my addr 10.20.193.78:0/2888246345 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.254+0000 7f2044eb56c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20401178a0 0x7f2040123010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f203ffff6c0 1 -- 10.20.193.78:0/2888246345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20401178a0 msgr2=0x7f2040123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f203ffff6c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20401178a0 0x7f2040123010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f203ffff6c0 1 -- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f20401193d0 msgr2=0x7f2040124250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f203ffff6c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f20401193d0 0x7f2040124250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f203ffff6c0 1 -- 10.20.193.78:0/2888246345 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c009590 con 0x7f2040118a20 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f2044eb56c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20401178a0 0x7f2040123010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f203ffff6c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040123660 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f202c005b40 tx=0x7f202c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.255+0000 7f203dffb6c0 1 -- 10.20.193.78:0/2888246345 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f202c0029d0 con 0x7f2040118a20 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.256+0000 7f203dffb6c0 1 -- 10.20.193.78:0/2888246345 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f202c002b30 con 0x7f2040118a20 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.256+0000 7f203dffb6c0 1 -- 10.20.193.78:0/2888246345 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f202c007440 con 0x7f2040118a20 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.256+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2040124f90 con 0x7f2040118a20 2026-02-13T02:39:37.259 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.256+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2040165490 con 0x7f2040118a20 2026-02-13T02:39:37.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.257+0000 7f203dffb6c0 1 -- 10.20.193.78:0/2888246345 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f202c0075a0 con 0x7f2040118a20 2026-02-13T02:39:37.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.257+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2008005310 con 0x7f2040118a20 2026-02-13T02:39:37.260 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.258+0000 7f203dffb6c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f201403f820 0x7f201405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.258+0000 7f203dffb6c0 1 -- 10.20.193.78:0/2888246345 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f202c075610 con 0x7f2040118a20 2026-02-13T02:39:37.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.260+0000 7f2044eb56c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f201403f820 0x7f201405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.260+0000 7f203dffb6c0 1 -- 10.20.193.78:0/2888246345 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f202c032270 con 0x7f2040118a20 2026-02-13T02:39:37.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: Optimize plan auto_2026-02-13_02:39:34, mode upmap, max misplaced 0.050000 2026-02-13T02:39:37.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: No pools available 2026-02-13T02:39:37.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: mgrmap e11: x(active, since 1.00896s) 2026-02-13T02:39:37.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial078=x;trial091=y;trial154=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1780401242' entity='client.admin' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:37.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:36 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:37.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.261+0000 7f2044eb56c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f201403f820 0x7f201405fcd0 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2034005830 tx=0x7f203400a310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.351 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.351 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.392+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f7d540051d0 con 0x7f7d9010eec0 2026-02-13T02:39:37.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.404+0000 7f7d8cff96c0 1 -- 10.20.193.78:0/1292506834 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f7d8000cc70 con 0x7f7d9010eec0 2026-02-13T02:39:37.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7d64048290 msgr2=0x7f7d64068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7d64048290 0x7f7d64068740 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d84007fd0 tx=0x7f7d84007e80 comp rx=0 tx=0).stop 2026-02-13T02:39:37.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d9010eec0 msgr2=0x7f7d900f84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d9010eec0 0x7f7d900f84d0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d80009490 tx=0x7f7d8000bca0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 shutdown_connections 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7d64048290 0x7f7d64068740 unknown :-1 s=CLOSED pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7d901109f0 0x7f7d900f8d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7d90110040 0x7f7d90171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 --2- 10.20.193.78:0/1292506834 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7d9010eec0 0x7f7d900f84d0 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.409+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 >> 10.20.193.78:0/1292506834 conn(0x7f7d900ec5e0 msgr2=0x7f7d900ee570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.410+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 shutdown_connections 2026-02-13T02:39:37.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.410+0000 7f7d95d376c0 1 -- 10.20.193.78:0/1292506834 wait complete. 2026-02-13T02:39:37.476 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.484 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.480+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f20080055c0 con 0x7f2040118a20 2026-02-13T02:39:37.551 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.551 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.552+0000 7f203dffb6c0 1 -- 10.20.193.78:0/2888246345 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f202c032270 con 0x7f2040118a20 2026-02-13T02:39:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 -- 10.20.193.78:0/245030655 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c5920 msgr2=0x7f80601262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 --2- 10.20.193.78:0/245030655 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c5920 0x7f80601262b0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=3503868982848440590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8068000b70 tx=0x7f806807f730 comp rx=0 tx=0).stop 2026-02-13T02:39:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 -- 10.20.193.78:0/245030655 shutdown_connections 2026-02-13T02:39:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 --2- 10.20.193.78:0/245030655 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c5920 0x7f80601262b0 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=3503868982848440590 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 --2- 10.20.193.78:0/245030655 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80600c4f70 0x7f80600c53e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 --2- 10.20.193.78:0/245030655 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f80600c3df0 0x7f80600c41e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 -- 10.20.193.78:0/245030655 >> 10.20.193.78:0/245030655 conn(0x7f80600a10b0 msgr2=0x7f80600c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 -- 10.20.193.78:0/245030655 shutdown_connections 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.529+0000 7f806e3e36c0 1 -- 10.20.193.78:0/245030655 wait complete. 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.530+0000 7f806e3e36c0 1 Processor -- start 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.530+0000 7f806e3e36c0 1 -- start start 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f806e3e36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c3df0 0x7f8060135cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f806e3e36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f80600c4f70 0x7f8060136320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f806e3e36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80600c5920 0x7f8060126290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f806e3e36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f80601cf400 con 0x7f80600c5920 2026-02-13T02:39:37.567 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f806e3e36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f80601cf570 con 0x7f80600c4f70 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f806e3e36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80601cf730 con 0x7f80600c3df0 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f805ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c3df0 0x7f8060135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f805ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c3df0 0x7f8060135cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49842/0 (socket says 10.20.193.78:49842) 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f805ffff6c0 1 -- 10.20.193.78:0/3141514774 learned_addr learned my addr 10.20.193.78:0/3141514774 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.531+0000 7f805f7fe6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f80600c4f70 0x7f8060136320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f806d1566c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80600c5920 0x7f8060126290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f805ffff6c0 1 -- 10.20.193.78:0/3141514774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f80600c4f70 msgr2=0x7f8060136320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f805ffff6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f80600c4f70 0x7f8060136320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f805ffff6c0 1 -- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80600c5920 msgr2=0x7f8060126290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f805ffff6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80600c5920 0x7f8060126290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f805ffff6c0 1 -- 10.20.193.78:0/3141514774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806804beb0 con 0x7f80600c3df0 2026-02-13T02:39:37.568 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f805f7fe6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f80600c4f70 0x7f8060136320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f806d1566c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80600c5920 0x7f8060126290 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.532+0000 7f805ffff6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c3df0 0x7f8060135cd0 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8058009490 tx=0x7f805800bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.533+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8058004a80 con 0x7f80600c3df0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.533+0000 7f806e3e36c0 1 -- 10.20.193.78:0/3141514774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80601cfa10 con 0x7f80600c3df0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.533+0000 7f806e3e36c0 1 -- 10.20.193.78:0/3141514774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80601cff40 con 0x7f80600c3df0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.533+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8058009030 con 0x7f80600c3df0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.533+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8058004a80 con 0x7f80600c3df0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.534+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8034005310 con 0x7f80600c3df0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.534+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f805800cc20 con 0x7f80600c3df0 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.535+0000 7f805d7fa6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f804003f880 0x7f804005fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.569 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.535+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8058022600 con 0x7f80600c3df0 2026-02-13T02:39:37.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.535+0000 7f805f7fe6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f804003f880 0x7f804005fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.536+0000 7f805f7fe6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f804003f880 0x7f804005fd30 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8050005980 tx=0x7f8050009290 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.570 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.538+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f80580071c0 con 0x7f80600c3df0 2026-02-13T02:39:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.633+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/3687964781 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410e5a0 msgr2=0x7fe4a416ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.633+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/3687964781 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410e5a0 0x7fe4a416ef30 secure :-1 s=READY pgs=101 gs=3 cs=0 l=1 c_cookie=6518851226107257003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe494006fd0 tx=0x7fe49402fd70 comp rx=0 tx=0).stop 2026-02-13T02:39:37.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.637+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/3687964781 shutdown_connections 2026-02-13T02:39:37.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.637+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/3687964781 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410e5a0 0x7fe4a416ef30 unknown :-1 s=CLOSED pgs=101 gs=3 cs=0 l=1 c_cookie=6518851226107257003 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.637+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/3687964781 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 0x7fe4a410e060 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.637+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/3687964781 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe4a410ca70 0x7fe4a410ce60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.637+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/3687964781 >> 10.20.193.78:0/3687964781 conn(0x7fe4a40ea190 msgr2=0x7fe4a410a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.638+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/3687964781 shutdown_connections 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.638+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/3687964781 wait complete. 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.639+0000 7fe4a3fff6c0 1 Processor -- start 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.641+0000 7fe4a3fff6c0 1 -- start start 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.641+0000 7fe4a3fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410ca70 0x7fe4a40f2a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.641+0000 7fe4a3fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 0x7fe4a416ef30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe4a410e5a0 0x7fe4a40f3260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a3fff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a40f3e90 con 0x7fe4a410ca70 2026-02-13T02:39:37.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a3fff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a40f4000 con 0x7fe4a410e5a0 2026-02-13T02:39:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a3fff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a40f41c0 con 0x7fe4a410dbf0 2026-02-13T02:39:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a27fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 0x7fe4a416ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a27fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 0x7fe4a416ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49854/0 (socket says 10.20.193.78:49854) 2026-02-13T02:39:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a37fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe4a410e5a0 0x7fe4a40f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a27fc6c0 1 -- 10.20.193.78:0/4113884428 learned_addr learned my addr 10.20.193.78:0/4113884428 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.642+0000 7fe4a37fe6c0 1 -- 10.20.193.78:0/4113884428 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 msgr2=0x7fe4a416ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.643+0000 7fe4a2ffd6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410ca70 0x7fe4a40f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.643+0000 7fe4a37fe6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 0x7fe4a416ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.643+0000 7fe4a37fe6c0 1 -- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410ca70 msgr2=0x7fe4a40f2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.643+0000 7fe4a37fe6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410ca70 0x7fe4a40f2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.643+0000 7fe4a37fe6c0 1 -- 10.20.193.78:0/4113884428 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49400a5b0 con 0x7fe4a410e5a0 2026-02-13T02:39:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.643+0000 7fe4a27fc6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 0x7fe4a416ef30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:39:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.643+0000 7fe4a2ffd6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410ca70 0x7fe4a40f2a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:37.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.644+0000 7fe4a37fe6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe4a410e5a0 0x7fe4a40f3260 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe494006fd0 tx=0x7fe494005570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.648 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.644+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4940081c0 con 0x7fe4a410e5a0 2026-02-13T02:39:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.644+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe49400a030 con 0x7fe4a410e5a0 2026-02-13T02:39:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.644+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a40f4440 con 0x7fe4a410e5a0 2026-02-13T02:39:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.644+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe494036480 con 0x7fe4a410e5a0 2026-02-13T02:39:37.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.644+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a40f4870 con 0x7fe4a410e5a0 2026-02-13T02:39:37.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f4c089386c0 1 -- 10.20.193.78:0/1170712504 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 msgr2=0x7f4c00134350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f4c089386c0 1 --2- 10.20.193.78:0/1170712504 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 0x7f4c00134350 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=4243896097092241118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bf8009970 tx=0x7f4bf802ed50 comp rx=0 tx=0).stop 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.657+0000 7f4c089386c0 1 -- 10.20.193.78:0/1170712504 shutdown_connections 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.657+0000 7f4c089386c0 1 --2- 10.20.193.78:0/1170712504 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c001554e0 0x7f4c00175990 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.657+0000 7f4c089386c0 1 --2- 10.20.193.78:0/1170712504 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 0x7f4c00154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.657+0000 7f4c089386c0 1 --2- 10.20.193.78:0/1170712504 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 0x7f4c00134350 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=4243896097092241118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.657+0000 7f4c089386c0 1 -- 10.20.193.78:0/1170712504 >> 10.20.193.78:0/1170712504 conn(0x7f4c0005b8e0 msgr2=0x7f4c0005bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.657+0000 7f4c089386c0 1 -- 10.20.193.78:0/1170712504 shutdown_connections 2026-02-13T02:39:37.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.650+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a4173030 con 0x7fe4a410e5a0 2026-02-13T02:39:37.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.650+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fe4940365e0 con 0x7fe4a410e5a0 2026-02-13T02:39:37.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.650+0000 7fe483fff6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe47403f820 0x7fe47405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.652+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe4940764e0 con 0x7fe4a410e5a0 2026-02-13T02:39:37.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.652+0000 7fe4a2ffd6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe47403f820 0x7fe47405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7fe4a2ffd6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe47403f820 0x7fe47405fcd0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe48c004750 tx=0x7fe48c005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe494006c50 con 0x7fe4a410e5a0 2026-02-13T02:39:37.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.658+0000 7f4c089386c0 1 -- 10.20.193.78:0/1170712504 wait complete. 2026-02-13T02:39:37.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.655+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f201403f820 msgr2=0x7f201405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.655+0000 7f20471446c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f201403f820 0x7f201405fcd0 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2034005830 tx=0x7f203400a310 comp rx=0 tx=0).stop 2026-02-13T02:39:37.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 msgr2=0x7f2040123660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040123660 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f202c005b40 tx=0x7f202c004730 comp rx=0 tx=0).stop 2026-02-13T02:39:37.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 shutdown_connections 2026-02-13T02:39:37.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f201403f820 0x7f201405fcd0 unknown :-1 s=CLOSED pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f20401193d0 0x7f2040124250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2040118a20 0x7f2040123660 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 --2- 10.20.193.78:0/2888246345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20401178a0 0x7f2040123010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 >> 10.20.193.78:0/2888246345 conn(0x7f20400f4fc0 msgr2=0x7f20401153a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 shutdown_connections 2026-02-13T02:39:37.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.656+0000 7f20471446c0 1 -- 10.20.193.78:0/2888246345 wait complete. 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.660+0000 7f4c089386c0 1 Processor -- start 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.660+0000 7f4c089386c0 1 -- start start 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c089386c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 0x7f4c00134350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c089386c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 0x7f4c00175970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c089386c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c001554e0 0x7f4c00135490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c066a96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 0x7f4c00134350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c089386c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4c00135c20 con 0x7f4c00113f70 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c089386c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4c00135d90 con 0x7f4c001554e0 2026-02-13T02:39:37.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c089386c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c001363d0 con 0x7f4c00134920 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c05ea86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 0x7f4c00175970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c05ea86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 0x7f4c00175970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49866/0 (socket says 10.20.193.78:49866) 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c05ea86c0 1 -- 10.20.193.78:0/2205613462 learned_addr learned my addr 10.20.193.78:0/2205613462 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c066a96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 0x7f4c00134350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47394/0 (socket says 10.20.193.78:47394) 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.661+0000 7f4c06eaa6c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c001554e0 0x7f4c00135490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4c05ea86c0 1 -- 10.20.193.78:0/2205613462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c001554e0 msgr2=0x7f4c00135490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4c05ea86c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c001554e0 0x7f4c00135490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4c05ea86c0 1 -- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 msgr2=0x7f4c00134350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4c05ea86c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 0x7f4c00134350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4c05ea86c0 1 -- 10.20.193.78:0/2205613462 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf8009590 con 0x7f4c00134920 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4c06eaa6c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c001554e0 0x7f4c00135490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:39:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4c05ea86c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 0x7f4c00175970 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bec00b6c0 tx=0x7f4bec00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.662+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bec004240 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.663+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c001366b0 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.663+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c00136b90 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.663+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4bec009030 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.663+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bec00cd10 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.665+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f4bec0043a0 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.665+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c00179180 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.666+0000 7f4beb7fe6c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be003f870 0x7f4be005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.666+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4bec050fe0 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.670+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4bec011710 con 0x7f4c00134920 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.671+0000 7f4c066a96c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be003f870 0x7f4be005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.677+0000 7f4c066a96c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be003f870 0x7f4be005fd20 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bf80098c0 tx=0x7f4bf802fa70 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.755 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.758+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f806012a040 con 0x7f80600c3df0 2026-02-13T02:39:37.768 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.770+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f4bec0071c0 con 0x7f4c00134920 2026-02-13T02:39:37.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.802+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f805800cc20 con 0x7f80600c3df0 2026-02-13T02:39:37.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.803+0000 7f805d7fa6c0 1 -- 10.20.193.78:0/3141514774 <== mon.1 v2:10.20.193.154:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v17)=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f8058051a00 con 0x7f80600c3df0 2026-02-13T02:39:37.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.769+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fe494004d70 con 0x7fe4a410e5a0 2026-02-13T02:39:37.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.783+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fe4680051d0 con 0x7fe4a410e5a0 2026-02-13T02:39:37.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.789+0000 7fe483fff6c0 1 -- 10.20.193.78:0/4113884428 <== mon.2 v2:10.20.193.91:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v18)=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7fe4940089f0 con 0x7fe4a410e5a0 2026-02-13T02:39:37.811 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.811 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.811 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.812 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.812 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.828 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.832 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.814+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f804003f880 msgr2=0x7f804005fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.814+0000 7f803effd6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f804003f880 0x7f804005fd30 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8050005980 tx=0x7f8050009290 comp rx=0 tx=0).stop 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.814+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c3df0 msgr2=0x7f8060135cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.814+0000 7f803effd6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c3df0 0x7f8060135cd0 secure :-1 s=READY pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8058009490 tx=0x7f805800bca0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 shutdown_connections 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f804003f880 0x7f804005fd30 unknown :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80600c5920 0x7f8060126290 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f80600c4f70 0x7f8060136320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 --2- 10.20.193.78:0/3141514774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f80600c3df0 0x7f8060135cd0 unknown :-1 s=CLOSED pgs=12 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 >> 10.20.193.78:0/3141514774 conn(0x7f80600a10b0 msgr2=0x7f80600c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.833 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 shutdown_connections 2026-02-13T02:39:37.834 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.815+0000 7f803effd6c0 1 -- 10.20.193.78:0/3141514774 wait complete. 2026-02-13T02:39:37.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.840+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f4c00136e70 con 0x7f4c00134920 2026-02-13T02:39:37.848 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe47403f820 msgr2=0x7fe47405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe47403f820 0x7fe47405fcd0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe48c004750 tx=0x7fe48c005f10 comp rx=0 tx=0).stop 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe4a410e5a0 msgr2=0x7fe4a40f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe4a410e5a0 0x7fe4a40f3260 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe494006fd0 tx=0x7fe494005570 comp rx=0 tx=0).stop 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 shutdown_connections 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe47403f820 0x7fe47405fcd0 unknown :-1 s=CLOSED pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe4a410e5a0 0x7fe4a40f3260 unknown :-1 s=CLOSED pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe4a410dbf0 0x7fe4a416ef30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 --2- 10.20.193.78:0/4113884428 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe4a410ca70 0x7fe4a40f2a00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 >> 10.20.193.78:0/4113884428 conn(0x7fe4a40ea190 msgr2=0x7fe4a4060fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 shutdown_connections 2026-02-13T02:39:37.849 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.829+0000 7fe4a3fff6c0 1 -- 10.20.193.78:0/4113884428 wait complete. 2026-02-13T02:39:37.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.844+0000 7f4beb7fe6c0 1 -- 10.20.193.78:0/2205613462 <== mon.1 v2:10.20.193.154:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7f4bec003b30 con 0x7f4c00134920 2026-02-13T02:39:37.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.849+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be003f870 msgr2=0x7f4be005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.849+0000 7f4c089386c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be003f870 0x7f4be005fd20 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bf80098c0 tx=0x7f4bf802fa70 comp rx=0 tx=0).stop 2026-02-13T02:39:37.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.849+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 msgr2=0x7f4c00175970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.849+0000 7f4c089386c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 0x7f4c00175970 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bec00b6c0 tx=0x7f4bec00bb90 comp rx=0 tx=0).stop 2026-02-13T02:39:37.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.849+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 shutdown_connections 2026-02-13T02:39:37.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.849+0000 7f4c089386c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be003f870 0x7f4be005fd20 unknown :-1 s=CLOSED pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.850+0000 7f4c089386c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c001554e0 0x7f4c00135490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.850+0000 7f4c089386c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c00134920 0x7f4c00175970 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.850+0000 7f4c089386c0 1 --2- 10.20.193.78:0/2205613462 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c00113f70 0x7f4c00134350 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.850+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 >> 10.20.193.78:0/2205613462 conn(0x7f4c0005b8e0 msgr2=0x7f4c0017c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.850+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 shutdown_connections 2026-02-13T02:39:37.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.850+0000 7f4c089386c0 1 -- 10.20.193.78:0/2205613462 wait complete. 2026-02-13T02:39:37.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.876+0000 7fe60e7fc6c0 1 -- 10.20.193.78:0/669331420 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe5fc02fd70 con 0x7fe610114120 2026-02-13T02:39:37.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.878+0000 7fe6148106c0 1 -- 10.20.193.78:0/669331420 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114120 msgr2=0x7fe610114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.880 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.878+0000 7fe6148106c0 1 --2- 10.20.193.78:0/669331420 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114120 0x7fe610114570 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=14717633522279469723 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5fc0098a0 tx=0x7fe5fc02ec40 comp rx=0 tx=0).stop 2026-02-13T02:39:37.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.879+0000 7fe6148106c0 1 -- 10.20.193.78:0/669331420 shutdown_connections 2026-02-13T02:39:37.881 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.879+0000 7fe6148106c0 1 --2- 10.20.193.78:0/669331420 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe610114cb0 0x7fe6101757c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.879+0000 7fe6148106c0 1 --2- 10.20.193.78:0/669331420 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114120 0x7fe610114570 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=14717633522279469723 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.879+0000 7fe6148106c0 1 --2- 10.20.193.78:0/669331420 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6101137a0 0x7fe610113b90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.879+0000 7fe6148106c0 1 -- 10.20.193.78:0/669331420 >> 10.20.193.78:0/669331420 conn(0x7fe610064120 msgr2=0x7fe610064540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.879+0000 7fe6148106c0 1 -- 10.20.193.78:0/669331420 shutdown_connections 2026-02-13T02:39:37.882 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.880+0000 7fe6148106c0 1 -- 10.20.193.78:0/669331420 wait complete. 2026-02-13T02:39:37.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.885+0000 7fe6148106c0 1 Processor -- start 2026-02-13T02:39:37.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.885+0000 7fe6148106c0 1 -- start start 2026-02-13T02:39:37.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.888+0000 7fe6148106c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6101137a0 0x7fe610119780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.888+0000 7fe6148106c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe610114120 0x7fe610119dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.889+0000 7f967850d6c0 1 -- 10.20.193.78:0/1980262024 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 msgr2=0x7f96701139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.889+0000 7f967850d6c0 1 --2- 10.20.193.78:0/1980262024 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f96701139d0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=11398010015122583201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9664009970 tx=0x7f966402ed50 comp rx=0 tx=0).stop 2026-02-13T02:39:37.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.889+0000 7f967527c6c0 1 -- 10.20.193.78:0/1980262024 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f966402fdd0 con 0x7f9670113560 2026-02-13T02:39:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.888+0000 7fe6148106c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114cb0 0x7fe61011a9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7f967850d6c0 1 -- 10.20.193.78:0/1980262024 shutdown_connections 2026-02-13T02:39:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7f967850d6c0 1 --2- 10.20.193.78:0/1980262024 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9670113f10 0x7f9670175890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7f967850d6c0 1 --2- 10.20.193.78:0/1980262024 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f96701139d0 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=11398010015122583201 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7f967850d6c0 1 --2- 10.20.193.78:0/1980262024 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9670114810 0x7f9670114c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7f967850d6c0 1 -- 10.20.193.78:0/1980262024 >> 10.20.193.78:0/1980262024 conn(0x7f96700642f0 msgr2=0x7f9670064710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7fe6148106c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe61011b150 con 0x7fe610114120 2026-02-13T02:39:37.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7fe6148106c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe61011b2c0 con 0x7fe6101137a0 2026-02-13T02:39:37.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7fe6148106c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe61011b480 con 0x7fe610114cb0 2026-02-13T02:39:37.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7fe60ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114cb0 0x7fe61011a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.890+0000 7fe60f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6101137a0 0x7fe610119780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.891+0000 7f967850d6c0 1 -- 10.20.193.78:0/1980262024 shutdown_connections 2026-02-13T02:39:37.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.891+0000 7fe60ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114cb0 0x7fe61011a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49898/0 (socket says 10.20.193.78:49898) 2026-02-13T02:39:37.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.891+0000 7fe60ffff6c0 1 -- 10.20.193.78:0/353134527 learned_addr learned my addr 10.20.193.78:0/353134527 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.891+0000 7f967850d6c0 1 -- 10.20.193.78:0/1980262024 wait complete. 2026-02-13T02:39:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.892+0000 7fe60effd6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe610114120 0x7fe610119dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.893+0000 7f967850d6c0 1 Processor -- start 2026-02-13T02:39:37.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.893+0000 7f967850d6c0 1 -- start start 2026-02-13T02:39:37.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.894+0000 7f967850d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f9670118be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.894+0000 7f967850d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9670113f10 0x7f9670119230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.894+0000 7f967850d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9670114810 0x7f9670119e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.906+0000 7f967850d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f967011a520 con 0x7f9670113f10 2026-02-13T02:39:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.906+0000 7f967850d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f967011a690 con 0x7f9670114810 2026-02-13T02:39:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.906+0000 7f967850d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f967011a850 con 0x7f9670113560 2026-02-13T02:39:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.906+0000 7f967627e6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f9670118be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.906+0000 7f967627e6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f9670118be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49910/0 (socket says 10.20.193.78:49910) 2026-02-13T02:39:37.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.906+0000 7f967627e6c0 1 -- 10.20.193.78:0/2976136099 learned_addr learned my addr 10.20.193.78:0/2976136099 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.909+0000 7fe60ffff6c0 1 -- 10.20.193.78:0/353134527 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6101137a0 msgr2=0x7fe610119780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.909+0000 7fe60ffff6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6101137a0 0x7fe610119780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.909+0000 7fe60ffff6c0 1 -- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe610114120 msgr2=0x7fe610119dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7fe60ffff6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe610114120 0x7fe610119dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7fe60ffff6c0 1 -- 10.20.193.78:0/353134527 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe600009590 con 0x7fe610114cb0 2026-02-13T02:39:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7fe60f7fe6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6101137a0 0x7fe610119780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:39:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7fe60effd6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe610114120 0x7fe610119dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7fe60ffff6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114cb0 0x7fe61011a9c0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe604006ea0 tx=0x7fe60400ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.912+0000 7fe60cff96c0 1 -- 10.20.193.78:0/353134527 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe604003c40 con 0x7fe610114cb0 2026-02-13T02:39:37.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.912+0000 7fe60cff96c0 1 -- 10.20.193.78:0/353134527 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe604003da0 con 0x7fe610114cb0 2026-02-13T02:39:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.912+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5fc0094c0 con 0x7fe610114cb0 2026-02-13T02:39:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.912+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61015bc00 con 0x7fe610114cb0 2026-02-13T02:39:37.915 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.912+0000 7fe60cff96c0 1 -- 10.20.193.78:0/353134527 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe6040081c0 con 0x7fe610114cb0 2026-02-13T02:39:37.921 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:37.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.908+0000 7f9676a7f6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9670114810 0x7f9670119e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.908+0000 7f967627e6c0 1 -- 10.20.193.78:0/2976136099 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9670114810 msgr2=0x7f9670119e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.908+0000 7f967627e6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9670114810 0x7f9670119e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.908+0000 7f967627e6c0 1 -- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9670113f10 msgr2=0x7f9670119230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.908+0000 7f9675a7d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9670113f10 0x7f9670119230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.909+0000 7f967627e6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9670113f10 0x7f9670119230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.909+0000 7f967627e6c0 1 -- 10.20.193.78:0/2976136099 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9664009590 con 0x7f9670113560 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.910+0000 7f967627e6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f9670118be0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966000b6c0 tx=0x7f966000bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7f965f7fe6c0 1 -- 10.20.193.78:0/2976136099 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9660004560 con 0x7f9670113560 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7f965f7fe6c0 1 -- 10.20.193.78:0/2976136099 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9660009030 con 0x7f9670113560 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7f965f7fe6c0 1 -- 10.20.193.78:0/2976136099 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f966000ce30 con 0x7f9670113560 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967011ab30 con 0x7f9670113560 2026-02-13T02:39:37.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.911+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f967015b060 con 0x7f9670113560 2026-02-13T02:39:37.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.912+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9670179930 con 0x7f9670113560 2026-02-13T02:39:37.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.913+0000 7f965f7fe6c0 1 -- 10.20.193.78:0/2976136099 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f96600071c0 con 0x7f9670113560 2026-02-13T02:39:37.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.913+0000 7f965f7fe6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f964803f990 0x7f964805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.913+0000 7f965f7fe6c0 1 -- 10.20.193.78:0/2976136099 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f9660051410 con 0x7f9670113560 2026-02-13T02:39:37.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.915+0000 7f965f7fe6c0 1 -- 10.20.193.78:0/2976136099 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9660012d70 con 0x7f9670113560 2026-02-13T02:39:37.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.923+0000 7f9675a7d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f964803f990 0x7f964805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.924+0000 7f9675a7d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f964803f990 0x7f964805fe40 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96640092e0 tx=0x7f966402f9c0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.917+0000 7fe60cff96c0 1 -- 10.20.193.78:0/353134527 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fe604008350 con 0x7fe610114cb0 2026-02-13T02:39:37.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.917+0000 7fe60cff96c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe5e403f990 0x7fe5e405fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.917+0000 7fe60cff96c0 1 -- 10.20.193.78:0/353134527 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe6040523c0 con 0x7fe610114cb0 2026-02-13T02:39:37.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.923+0000 7fe60f7fe6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe5e403f990 0x7fe5e405fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.924+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe610067670 con 0x7fe610114cb0 2026-02-13T02:39:37.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.925+0000 7fe60f7fe6c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe5e403f990 0x7fe5e405fe40 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe600005b40 tx=0x7fe600009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.928+0000 7fe60cff96c0 1 -- 10.20.193.78:0/353134527 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe6040153f0 con 0x7fe610114cb0 2026-02-13T02:39:37.936 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.934+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/472585023 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c3df0 msgr2=0x7f39d80c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.934+0000 7f39e7d9c6c0 1 --2- 10.20.193.78:0/472585023 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c3df0 0x7f39d80c41e0 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=854092713217121479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39e0054080 tx=0x7f39e0080830 comp rx=0 tx=0).stop 2026-02-13T02:39:37.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.935+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/472585023 shutdown_connections 2026-02-13T02:39:37.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.935+0000 7f39e7d9c6c0 1 --2- 10.20.193.78:0/472585023 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c5920 0x7f39d81262b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.935+0000 7f39e7d9c6c0 1 --2- 10.20.193.78:0/472585023 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f39d80c4f70 0x7f39d80c53e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.935+0000 7f39e7d9c6c0 1 --2- 10.20.193.78:0/472585023 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c3df0 0x7f39d80c41e0 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=854092713217121479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.935+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/472585023 >> 10.20.193.78:0/472585023 conn(0x7f39d80a10b0 msgr2=0x7f39d80c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:37.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.935+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/472585023 shutdown_connections 2026-02-13T02:39:37.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.935+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/472585023 wait complete. 2026-02-13T02:39:37.938 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.937+0000 7f39e7d9c6c0 1 Processor -- start 2026-02-13T02:39:37.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.942+0000 7f39e7d9c6c0 1 -- start start 2026-02-13T02:39:37.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.944+0000 7f39e7d9c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f39d80c3df0 0x7f39d80b1310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.944+0000 7f39e7d9c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c4f70 0x7f39d81262b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.944+0000 7f39e7d9c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c5920 0x7f39d80b1b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.944+0000 7f39e6b136c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c4f70 0x7f39d81262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.947 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.945+0000 7f39e6b136c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c4f70 0x7f39d81262b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49932/0 (socket says 10.20.193.78:49932) 2026-02-13T02:39:37.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.946+0000 7f39e6b136c0 1 -- 10.20.193.78:0/2901618317 learned_addr learned my addr 10.20.193.78:0/2901618317 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:37.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.945+0000 7f39e53106c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f39d80c3df0 0x7f39d80b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.946+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80b27a0 con 0x7f39d80c3df0 2026-02-13T02:39:37.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.946+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80b2910 con 0x7f39d80c5920 2026-02-13T02:39:37.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.946+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80b2ad0 con 0x7f39d80c4f70 2026-02-13T02:39:37.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.946+0000 7f39e5b116c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c5920 0x7f39d80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.946+0000 7f39e6b136c0 1 -- 10.20.193.78:0/2901618317 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c5920 msgr2=0x7f39d80b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.947+0000 7f39e6b136c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c5920 0x7f39d80b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.947+0000 7f39e6b136c0 1 -- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f39d80c3df0 msgr2=0x7f39d80b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:37.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.947+0000 7f39e6b136c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f39d80c3df0 0x7f39d80b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:37.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.947+0000 7f39e6b136c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e004beb0 con 0x7f39d80c4f70 2026-02-13T02:39:37.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.947+0000 7f39e5b116c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c5920 0x7f39d80b1b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:37.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.947+0000 7f39e53106c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f39d80c3df0 0x7f39d80b1310 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:39:37.955 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial078') 2026-02-13T02:39:37.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.950+0000 7f39e6b136c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c4f70 0x7f39d81262b0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39d400b6c0 tx=0x7f39d400bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.950+0000 7f39ceffd6c0 1 -- 10.20.193.78:0/2901618317 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39d40044a0 con 0x7f39d80c4f70 2026-02-13T02:39:37.956 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.950+0000 7f39ceffd6c0 1 -- 10.20.193.78:0/2901618317 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f39d400be50 con 0x7f39d80c4f70 2026-02-13T02:39:37.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.950+0000 7f39ceffd6c0 1 -- 10.20.193.78:0/2901618317 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39d40044a0 con 0x7f39d80c4f70 2026-02-13T02:39:37.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.954+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d80b2db0 con 0x7f39d80c4f70 2026-02-13T02:39:37.957 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.954+0000 7f39e7d9c6c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d80b3210 con 0x7f39d80c4f70 2026-02-13T02:39:37.959 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.956+0000 7f39ceffd6c0 1 -- 10.20.193.78:0/2901618317 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f39d400cbd0 con 0x7f39d80c4f70 2026-02-13T02:39:37.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.957+0000 7f39ceffd6c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f39bc03f9a0 0x7f39bc05fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:37.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.957+0000 7f39ceffd6c0 1 -- 10.20.193.78:0/2901618317 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f39d4055550 con 0x7f39d80c4f70 2026-02-13T02:39:37.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.957+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d8129f90 con 0x7f39d80c4f70 2026-02-13T02:39:37.960 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.958+0000 7f39e53106c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f39bc03f9a0 0x7f39bc05fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:37.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.959+0000 7f39e53106c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f39bc03f9a0 0x7f39bc05fe50 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39e0053880 tx=0x7f39e0053ec0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:37.964 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:37.961+0000 7f39ceffd6c0 1 -- 10.20.193.78:0/2901618317 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f39d400d3d0 con 0x7f39d80c4f70 2026-02-13T02:39:37.994 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2272815689' entity='client.admin' 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/815848255' entity='client.admin' 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1292506834' entity='client.admin' 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: mgrmap e12: x(active, since 2s) 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.032 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:37 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.055+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/2416984296 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c5920 msgr2=0x7f27c01262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.057 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.055+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/2416984296 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c5920 0x7f27c01262b0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=5255804465344136751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c8052b90 tx=0x7f27c8080810 comp rx=0 tx=0).stop 2026-02-13T02:39:38.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.055+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/2416984296 shutdown_connections 2026-02-13T02:39:38.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.056+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/2416984296 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c5920 0x7f27c01262b0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=5255804465344136751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.056+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/2416984296 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c4f70 0x7f27c00c53e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.056+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/2416984296 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f27c00c3df0 0x7f27c00c41e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.056+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/2416984296 >> 10.20.193.78:0/2416984296 conn(0x7f27c00a10b0 msgr2=0x7f27c00c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.056+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/2416984296 shutdown_connections 2026-02-13T02:39:38.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.056+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/2416984296 wait complete. 2026-02-13T02:39:38.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.057+0000 7f27cf6d16c0 1 Processor -- start 2026-02-13T02:39:38.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.058+0000 7f27cf6d16c0 1 -- start start 2026-02-13T02:39:38.060 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.058+0000 7f27cf6d16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c3df0 0x7f27c01363d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27cf6d16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f27c00c4f70 0x7f27c01062a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27cf6d16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c5920 0x7f27c01069d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27cf6d16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0107160 con 0x7f27c00c3df0 2026-02-13T02:39:38.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27cf6d16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f27c01072d0 con 0x7f27c00c4f70 2026-02-13T02:39:38.061 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27cf6d16c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27c0107490 con 0x7f27c00c5920 2026-02-13T02:39:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27cd4426c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c3df0 0x7f27c01363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27ce4446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c5920 0x7f27c01069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27ce4446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c5920 0x7f27c01069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49956/0 (socket says 10.20.193.78:49956) 2026-02-13T02:39:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.059+0000 7f27ce4446c0 1 -- 10.20.193.78:0/3023135184 learned_addr learned my addr 10.20.193.78:0/3023135184 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.062 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.060+0000 7f27cd4426c0 1 -- 10.20.193.78:0/3023135184 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c5920 msgr2=0x7f27c01069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.060+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fe610066eb0 con 0x7fe610114cb0 2026-02-13T02:39:38.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.057+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f96701791a0 con 0x7f9670113560 2026-02-13T02:39:38.063 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f965f7fe6c0 1 -- 10.20.193.78:0/2976136099 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f9660012540 con 0x7f9670113560 2026-02-13T02:39:38.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f27cd4426c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c5920 0x7f27c01069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f27cd4426c0 1 -- 10.20.193.78:0/3023135184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f27c00c4f70 msgr2=0x7f27c01062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f27ccc416c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f27c00c4f70 0x7f27c01062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f27cd4426c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f27c00c4f70 0x7f27c01062a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f27cd4426c0 1 -- 10.20.193.78:0/3023135184 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c804beb0 con 0x7f27c00c3df0 2026-02-13T02:39:38.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f27ce4446c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c5920 0x7f27c01069d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:38.064 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.061+0000 7f27ccc416c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f27c00c4f70 0x7f27c01062a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.066 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f964803f990 msgr2=0x7f964805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f964803f990 0x7f964805fe40 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96640092e0 tx=0x7f966402f9c0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 msgr2=0x7f9670118be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f9670118be0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966000b6c0 tx=0x7f966000bb90 comp rx=0 tx=0).stop 2026-02-13T02:39:38.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 shutdown_connections 2026-02-13T02:39:38.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f964803f990 0x7f964805fe40 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9670114810 0x7f9670119e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9670113f10 0x7f9670119230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 --2- 10.20.193.78:0/2976136099 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9670113560 0x7f9670118be0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 >> 10.20.193.78:0/2976136099 conn(0x7f96700642f0 msgr2=0x7f9670068fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 shutdown_connections 2026-02-13T02:39:38.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.065+0000 7f967850d6c0 1 -- 10.20.193.78:0/2976136099 wait complete. 2026-02-13T02:39:38.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.066+0000 7fe60cff96c0 1 -- 10.20.193.78:0/353134527 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v21)=0 v21) ==== 116+0+0 (secure 0 0 0) 0x7fe604012540 con 0x7fe610114cb0 2026-02-13T02:39:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.064+0000 7f27cd4426c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c3df0 0x7f27c01363d0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c400b6e0 tx=0x7f27c400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.066+0000 7f27b67fc6c0 1 -- 10.20.193.78:0/3023135184 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27c4004a80 con 0x7f27c00c3df0 2026-02-13T02:39:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.067+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c0107770 con 0x7f27c00c3df0 2026-02-13T02:39:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.067+0000 7f27b67fc6c0 1 -- 10.20.193.78:0/3023135184 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f27c4009030 con 0x7f27c00c3df0 2026-02-13T02:39:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.067+0000 7f27b67fc6c0 1 -- 10.20.193.78:0/3023135184 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27c400cd10 con 0x7f27c00c3df0 2026-02-13T02:39:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.067+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c0107ca0 con 0x7f27c00c3df0 2026-02-13T02:39:38.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.068+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c0129e80 con 0x7f27c00c3df0 2026-02-13T02:39:38.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.071+0000 7f27b67fc6c0 1 -- 10.20.193.78:0/3023135184 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f27c4004be0 con 0x7f27c00c3df0 2026-02-13T02:39:38.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.072+0000 7f27b67fc6c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27a403f8c0 0x7f27a405fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.072+0000 7f27b67fc6c0 1 -- 10.20.193.78:0/3023135184 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f27c40512b0 con 0x7f27c00c3df0 2026-02-13T02:39:38.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.072+0000 7f27b67fc6c0 1 -- 10.20.193.78:0/3023135184 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f27c4051660 con 0x7f27c00c3df0 2026-02-13T02:39:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.072+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe5e403f990 msgr2=0x7fe5e405fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.072+0000 7fe6148106c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe5e403f990 0x7fe5e405fe40 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe600005b40 tx=0x7fe600009310 comp rx=0 tx=0).stop 2026-02-13T02:39:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.072+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114cb0 msgr2=0x7fe61011a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.072+0000 7fe6148106c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114cb0 0x7fe61011a9c0 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe604006ea0 tx=0x7fe60400ce50 comp rx=0 tx=0).stop 2026-02-13T02:39:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 shutdown_connections 2026-02-13T02:39:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe5e403f990 0x7fe5e405fe40 unknown :-1 s=CLOSED pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe610114cb0 0x7fe61011a9c0 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe610114120 0x7fe610119dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 --2- 10.20.193.78:0/353134527 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6101137a0 0x7fe610119780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 >> 10.20.193.78:0/353134527 conn(0x7fe610064120 msgr2=0x7fe610069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 shutdown_connections 2026-02-13T02:39:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.073+0000 7fe6148106c0 1 -- 10.20.193.78:0/353134527 wait complete. 2026-02-13T02:39:38.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.076+0000 7f27ccc416c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27a403f8c0 0x7f27a405fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.077+0000 7f27ccc416c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27a403f8c0 0x7f27a405fd70 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27bc004750 tx=0x7f27bc009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.083+0000 7ff4d34846c0 1 -- 10.20.193.78:0/589817612 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc1146f0 msgr2=0x7ff4cc114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.083+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/589817612 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc1146f0 0x7ff4cc114b60 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=8864126266050045229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4c00098a0 tx=0x7ff4c002ed00 comp rx=0 tx=0).stop 2026-02-13T02:39:38.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.085+0000 7ff4d34846c0 1 -- 10.20.193.78:0/589817612 shutdown_connections 2026-02-13T02:39:38.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.085+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/589817612 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4cc115120 0x7ff4cc1155c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.085+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/589817612 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc1146f0 0x7ff4cc114b60 unknown :-1 s=CLOSED pgs=19 gs=3 cs=0 l=1 c_cookie=8864126266050045229 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.085+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/589817612 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff4cc113dc0 0x7ff4cc1141b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.085+0000 7ff4d34846c0 1 -- 10.20.193.78:0/589817612 >> 10.20.193.78:0/589817612 conn(0x7ff4cc05b8e0 msgr2=0x7ff4cc05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.085+0000 7ff4d34846c0 1 -- 10.20.193.78:0/589817612 shutdown_connections 2026-02-13T02:39:38.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.085+0000 7ff4d34846c0 1 -- 10.20.193.78:0/589817612 wait complete. 2026-02-13T02:39:38.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.086+0000 7ff4d34846c0 1 Processor -- start 2026-02-13T02:39:38.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.086+0000 7ff4d34846c0 1 -- start start 2026-02-13T02:39:38.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.087+0000 7ff4d34846c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff4cc113dc0 0x7ff4cc0ff760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.087+0000 7ff4d34846c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4cc1146f0 0x7ff4cc0ffdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.087+0000 7ff4d34846c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc115120 0x7ff4cc1009a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.088+0000 7ff4d34846c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc101130 con 0x7ff4cc1146f0 2026-02-13T02:39:38.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.088+0000 7ff4d19f66c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc115120 0x7ff4cc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.088+0000 7ff4d19f66c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc115120 0x7ff4cc1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49968/0 (socket says 10.20.193.78:49968) 2026-02-13T02:39:38.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.088+0000 7ff4d19f66c0 1 -- 10.20.193.78:0/419858555 learned_addr learned my addr 10.20.193.78:0/419858555 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.089+0000 7ff4d11f56c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff4cc113dc0 0x7ff4cc0ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.089+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc1012a0 con 0x7ff4cc113dc0 2026-02-13T02:39:38.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.089+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc101460 con 0x7ff4cc115120 2026-02-13T02:39:38.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.090+0000 7ff4d09f46c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4cc1146f0 0x7ff4cc0ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.090+0000 7ff4d19f66c0 1 -- 10.20.193.78:0/419858555 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff4cc113dc0 msgr2=0x7ff4cc0ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.090+0000 7ff4d19f66c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff4cc113dc0 0x7ff4cc0ff760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.090+0000 7ff4d19f66c0 1 -- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4cc1146f0 msgr2=0x7ff4cc0ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7ff4d19f66c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4cc1146f0 0x7ff4cc0ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f39d8129850 con 0x7f39d80c4f70 2026-02-13T02:39:38.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7ff4d19f66c0 1 -- 10.20.193.78:0/419858555 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c00094c0 con 0x7ff4cc115120 2026-02-13T02:39:38.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7ff4d19f66c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc115120 0x7ff4cc1009a0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4c8006ea0 tx=0x7ff4c800ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7ff4ba7fc6c0 1 -- 10.20.193.78:0/419858555 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4c8003c40 con 0x7ff4cc115120 2026-02-13T02:39:38.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7ff4ba7fc6c0 1 -- 10.20.193.78:0/419858555 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4c8003da0 con 0x7ff4cc115120 2026-02-13T02:39:38.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7ff4ba7fc6c0 1 -- 10.20.193.78:0/419858555 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4c8003c40 con 0x7ff4cc115120 2026-02-13T02:39:38.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.091+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc101740 con 0x7ff4cc115120 2026-02-13T02:39:38.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.092+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc179df0 con 0x7ff4cc115120 2026-02-13T02:39:38.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.093+0000 7ff4ba7fc6c0 1 -- 10.20.193.78:0/419858555 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7ff4c8005030 con 0x7ff4cc115120 2026-02-13T02:39:38.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.093+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4cc119940 con 0x7ff4cc115120 2026-02-13T02:39:38.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.093+0000 7ff4ba7fc6c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4a803f9a0 0x7ff4a805fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.093+0000 7ff4ba7fc6c0 1 -- 10.20.193.78:0/419858555 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ff4c8056550 con 0x7ff4cc115120 2026-02-13T02:39:38.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.095+0000 7ff4ba7fc6c0 1 -- 10.20.193.78:0/419858555 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4c8008550 con 0x7ff4cc115120 2026-02-13T02:39:38.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.096+0000 7ff4d11f56c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4a803f9a0 0x7ff4a805fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.096+0000 7f39ceffd6c0 1 -- 10.20.193.78:0/2901618317 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f39d4012710 con 0x7f39d80c4f70 2026-02-13T02:39:38.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.096+0000 7ff4d11f56c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4a803f9a0 0x7ff4a805fe50 secure :-1 s=READY pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4bc005fd0 tx=0x7ff4bc0093f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f39bc03f9a0 msgr2=0x7f39bc05fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f39bc03f9a0 0x7f39bc05fe50 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39e0053880 tx=0x7f39e0053ec0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c4f70 msgr2=0x7f39d81262b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c4f70 0x7f39d81262b0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39d400b6c0 tx=0x7f39d400bb90 comp rx=0 tx=0).stop 2026-02-13T02:39:38.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 shutdown_connections 2026-02-13T02:39:38.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f39bc03f9a0 0x7f39bc05fe50 unknown :-1 s=CLOSED pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f39d80c5920 0x7f39d80b1b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f39d80c4f70 0x7f39d81262b0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 --2- 10.20.193.78:0/2901618317 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f39d80c3df0 0x7f39d80b1310 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 >> 10.20.193.78:0/2901618317 conn(0x7f39d80a10b0 msgr2=0x7f39d80a7450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 shutdown_connections 2026-02-13T02:39:38.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.100+0000 7f39ccff96c0 1 -- 10.20.193.78:0/2901618317 wait complete. 2026-02-13T02:39:38.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.102+0000 7f0b95f456c0 1 -- 10.20.193.78:0/762523537 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b9010eec0 msgr2=0x7f0b9010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.102+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/762523537 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b9010eec0 0x7f0b9010f2b0 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=13559237142972992000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b800098a0 tx=0x7f0b8002ec40 comp rx=0 tx=0).stop 2026-02-13T02:39:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.102+0000 7f0b95f456c0 1 -- 10.20.193.78:0/762523537 shutdown_connections 2026-02-13T02:39:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.102+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/762523537 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0b901109f0 0x7f0b90171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.102+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/762523537 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b90110040 0x7f0b901104b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.102+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/762523537 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b9010eec0 0x7f0b9010f2b0 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=13559237142972992000 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.102+0000 7f0b95f456c0 1 -- 10.20.193.78:0/762523537 >> 10.20.193.78:0/762523537 conn(0x7f0b900ec5c0 msgr2=0x7f0b9010c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.108+0000 7f0b95f456c0 1 -- 10.20.193.78:0/762523537 shutdown_connections 2026-02-13T02:39:38.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.110+0000 7f0b95f456c0 1 -- 10.20.193.78:0/762523537 wait complete. 2026-02-13T02:39:38.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.111+0000 7f0b95f456c0 1 Processor -- start 2026-02-13T02:39:38.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.111+0000 7f0b95f456c0 1 -- start start 2026-02-13T02:39:38.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b95f456c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b9010eec0 0x7f0b900fd4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b95f456c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b90110040 0x7f0b90171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b95f456c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0b901109f0 0x7f0b900fdd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b8ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0b901109f0 0x7f0b900fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b95f456c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b900fe970 con 0x7f0b901109f0 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b95f456c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0b900feae0 con 0x7f0b90110040 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b95f456c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b900feca0 con 0x7f0b9010eec0 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b8f7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b9010eec0 0x7f0b900fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b8f7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b9010eec0 0x7f0b900fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49990/0 (socket says 10.20.193.78:49990) 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b8f7fe6c0 1 -- 10.20.193.78:0/596370877 learned_addr learned my addr 10.20.193.78:0/596370877 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.112+0000 7f0b8effd6c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b90110040 0x7f0b90171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.113+0000 7f0b8f7fe6c0 1 -- 10.20.193.78:0/596370877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b90110040 msgr2=0x7f0b90171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.113+0000 7f0b8f7fe6c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b90110040 0x7f0b90171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.113+0000 7f0b8f7fe6c0 1 -- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0b901109f0 msgr2=0x7f0b900fdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.113+0000 7f0b8f7fe6c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0b901109f0 0x7f0b900fdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.113+0000 7f0b8f7fe6c0 1 -- 10.20.193.78:0/596370877 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b800094c0 con 0x7f0b9010eec0 2026-02-13T02:39:38.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.115+0000 7f0b8f7fe6c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b9010eec0 0x7f0b900fd4e0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b80009230 tx=0x7f0b80004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.115+0000 7f0b8cff96c0 1 -- 10.20.193.78:0/596370877 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b80002ae0 con 0x7f0b9010eec0 2026-02-13T02:39:38.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.115+0000 7f0b8cff96c0 1 -- 10.20.193.78:0/596370877 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0b80002c40 con 0x7f0b9010eec0 2026-02-13T02:39:38.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.115+0000 7f0b8cff96c0 1 -- 10.20.193.78:0/596370877 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b800312b0 con 0x7f0b9010eec0 2026-02-13T02:39:38.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.115+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b900fef20 con 0x7f0b9010eec0 2026-02-13T02:39:38.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.115+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b900ff350 con 0x7f0b9010eec0 2026-02-13T02:39:38.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.116+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b900ff540 con 0x7f0b9010eec0 2026-02-13T02:39:38.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.116+0000 7f0b8cff96c0 1 -- 10.20.193.78:0/596370877 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f0b800071c0 con 0x7f0b9010eec0 2026-02-13T02:39:38.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.117+0000 7f0b8cff96c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0b5c03f990 0x7f0b5c05fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.117+0000 7f0b8cff96c0 1 -- 10.20.193.78:0/596370877 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f0b80075380 con 0x7f0b9010eec0 2026-02-13T02:39:38.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.117+0000 7f0b8effd6c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0b5c03f990 0x7f0b5c05fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.118+0000 7f0b8effd6c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0b5c03f990 0x7f0b5c05fe40 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b7c005b40 tx=0x7f0b7c009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.119+0000 7f0b8cff96c0 1 -- 10.20.193.78:0/596370877 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b80007e20 con 0x7f0b9010eec0 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2272815689' entity='client.admin' 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/815848255' entity='client.admin' 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1292506834' entity='client.admin' 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: mgrmap e12: x(active, since 2s) 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:37 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.199+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f27c00c41e0 con 0x7f27c00c3df0 2026-02-13T02:39:38.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.205+0000 7f27b67fc6c0 1 -- 10.20.193.78:0/3023135184 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v23)=0 v23) ==== 127+0+0 (secure 0 0 0) 0x7f27c4007550 con 0x7f27c00c3df0 2026-02-13T02:39:38.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.209+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27a403f8c0 msgr2=0x7f27a405fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.209+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27a403f8c0 0x7f27a405fd70 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27bc004750 tx=0x7f27bc009310 comp rx=0 tx=0).stop 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.209+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c3df0 msgr2=0x7f27c01363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.209+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c3df0 0x7f27c01363d0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c400b6e0 tx=0x7f27c400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.209+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 shutdown_connections 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.209+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27a403f8c0 0x7f27a405fd70 unknown :-1 s=CLOSED pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.209+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f27c00c5920 0x7f27c01069d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.210+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f27c00c4f70 0x7f27c01062a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.210+0000 7f27cf6d16c0 1 --2- 10.20.193.78:0/3023135184 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f27c00c3df0 0x7f27c01363d0 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.210+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 >> 10.20.193.78:0/3023135184 conn(0x7f27c00a10b0 msgr2=0x7f27c00c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.210+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 shutdown_connections 2026-02-13T02:39:38.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.210+0000 7f27cf6d16c0 1 -- 10.20.193.78:0/3023135184 wait complete. 2026-02-13T02:39:38.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.232+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f0b901753e0 con 0x7f0b9010eec0 2026-02-13T02:39:38.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.240+0000 7f0b8cff96c0 1 -- 10.20.193.78:0/596370877 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f0b80007e20 con 0x7f0b9010eec0 2026-02-13T02:39:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0b5c03f990 msgr2=0x7f0b5c05fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0b5c03f990 0x7f0b5c05fe40 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b7c005b40 tx=0x7f0b7c009310 comp rx=0 tx=0).stop 2026-02-13T02:39:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b9010eec0 msgr2=0x7f0b900fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b9010eec0 0x7f0b900fd4e0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b80009230 tx=0x7f0b80004530 comp rx=0 tx=0).stop 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 shutdown_connections 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0b5c03f990 0x7f0b5c05fe40 unknown :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0b901109f0 0x7f0b900fdd40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b90110040 0x7f0b90171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 --2- 10.20.193.78:0/596370877 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b9010eec0 0x7f0b900fd4e0 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 >> 10.20.193.78:0/596370877 conn(0x7f0b900ec5c0 msgr2=0x7f0b90062870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 shutdown_connections 2026-02-13T02:39:38.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.244+0000 7f0b95f456c0 1 -- 10.20.193.78:0/596370877 wait complete. 2026-02-13T02:39:38.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.256+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff4940051d0 con 0x7ff4cc115120 2026-02-13T02:39:38.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2272815689' entity='client.admin' 2026-02-13T02:39:38.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/815848255' entity='client.admin' 2026-02-13T02:39:38.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1292506834' entity='client.admin' 2026-02-13T02:39:38.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: mgrmap e12: x(active, since 2s) 2026-02-13T02:39:38.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:37 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:38.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.265+0000 7ff4ba7fc6c0 1 -- 10.20.193.78:0/419858555 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v25)=0 v25) ==== 120+0+0 (secure 0 0 0) 0x7ff4c8014020 con 0x7ff4cc115120 2026-02-13T02:39:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.268+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4a803f9a0 msgr2=0x7ff4a805fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.268+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4a803f9a0 0x7ff4a805fe50 secure :-1 s=READY pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4bc005fd0 tx=0x7ff4bc0093f0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.268+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc115120 msgr2=0x7ff4cc1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.268+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc115120 0x7ff4cc1009a0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4c8006ea0 tx=0x7ff4c800ce50 comp rx=0 tx=0).stop 2026-02-13T02:39:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.269+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 shutdown_connections 2026-02-13T02:39:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.269+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4a803f9a0 0x7ff4a805fe50 unknown :-1 s=CLOSED pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.269+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff4cc115120 0x7ff4cc1009a0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.269+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4cc1146f0 0x7ff4cc0ffdb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.269+0000 7ff4d34846c0 1 --2- 10.20.193.78:0/419858555 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff4cc113dc0 0x7ff4cc0ff760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.269+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 >> 10.20.193.78:0/419858555 conn(0x7ff4cc05b8e0 msgr2=0x7ff4cc0f5810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.270+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 shutdown_connections 2026-02-13T02:39:38.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.270+0000 7ff4d34846c0 1 -- 10.20.193.78:0/419858555 wait complete. 2026-02-13T02:39:38.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.340+0000 7fe6696bc6c0 1 -- 10.20.193.78:0/2272232764 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe66404cc40 con 0x7fe6600c5970 2026-02-13T02:39:38.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.340+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/2272232764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c5970 msgr2=0x7fe660126300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.340+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/2272232764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c5970 0x7fe660126300 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=9810135479759447837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe664050640 tx=0x7fe66407f850 comp rx=0 tx=0).stop 2026-02-13T02:39:38.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.343+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/2272232764 shutdown_connections 2026-02-13T02:39:38.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.343+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/2272232764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c5970 0x7fe660126300 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=9810135479759447837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.343+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/2272232764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6600c4fc0 0x7fe6600c5430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.343+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/2272232764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c3e40 0x7fe6600c4230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.343+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/2272232764 >> 10.20.193.78:0/2272232764 conn(0x7fe6600a10e0 msgr2=0x7fe6600c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.343+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/2272232764 shutdown_connections 2026-02-13T02:39:38.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.343+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/2272232764 wait complete. 2026-02-13T02:39:38.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.344+0000 7fe66b6c06c0 1 Processor -- start 2026-02-13T02:39:38.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.344+0000 7fe66b6c06c0 1 -- start start 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.344+0000 7fe66b6c06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c3e40 0x7fe6600cfa80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66b6c06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c4fc0 0x7fe6600d00d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66b6c06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6600c5970 0x7fe6600d0cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66b6c06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe6600d1450 con 0x7fe6600c3e40 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66b6c06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe6600d15c0 con 0x7fe6600c5970 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66b6c06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6600d1780 con 0x7fe6600c4fc0 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c4fc0 0x7fe6600d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c4fc0 0x7fe6600d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50012/0 (socket says 10.20.193.78:50012) 2026-02-13T02:39:38.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 -- 10.20.193.78:0/452472580 learned_addr learned my addr 10.20.193.78:0/452472580 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66aebf6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6600c5970 0x7fe6600d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 -- 10.20.193.78:0/452472580 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6600c5970 msgr2=0x7fe6600d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66a6be6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c3e40 0x7fe6600cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6600c5970 0x7fe6600d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 -- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c3e40 msgr2=0x7fe6600cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c3e40 0x7fe6600cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe669ebd6c0 1 -- 10.20.193.78:0/452472580 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66404beb0 con 0x7fe6600c4fc0 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.345+0000 7fe66a6be6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c3e40 0x7fe6600cfa80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.346+0000 7fe669ebd6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c4fc0 0x7fe6600d00d0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe65000b6c0 tx=0x7fe65000bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.346+0000 7fe64f7fe6c0 1 -- 10.20.193.78:0/452472580 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe650004240 con 0x7fe6600c4fc0 2026-02-13T02:39:38.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.346+0000 7fe64f7fe6c0 1 -- 10.20.193.78:0/452472580 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe650009030 con 0x7fe6600c4fc0 2026-02-13T02:39:38.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.348+0000 7fe64f7fe6c0 1 -- 10.20.193.78:0/452472580 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe65000cd10 con 0x7fe6600c4fc0 2026-02-13T02:39:38.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.348+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6600d1a60 con 0x7fe6600c4fc0 2026-02-13T02:39:38.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.348+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe660111f60 con 0x7fe6600c4fc0 2026-02-13T02:39:38.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.349+0000 7fe64f7fe6c0 1 -- 10.20.193.78:0/452472580 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fe6500043a0 con 0x7fe6600c4fc0 2026-02-13T02:39:38.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.350+0000 7fe64f7fe6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe64003f8c0 0x7fe64005fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.350+0000 7fe64f7fe6c0 1 -- 10.20.193.78:0/452472580 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe6500512a0 con 0x7fe6600c4fc0 2026-02-13T02:39:38.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.350+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe660129600 con 0x7fe6600c4fc0 2026-02-13T02:39:38.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.350+0000 7fe66a6be6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe64003f8c0 0x7fe64005fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.354+0000 7fe66a6be6c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe64003f8c0 0x7fe64005fd70 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe658004750 tx=0x7fe658009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.354+0000 7fe64f7fe6c0 1 -- 10.20.193.78:0/452472580 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe65000f050 con 0x7fe6600c4fc0 2026-02-13T02:39:38.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.489+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fe660128db0 con 0x7fe6600c4fc0 2026-02-13T02:39:38.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.492+0000 7fe64f7fe6c0 1 -- 10.20.193.78:0/452472580 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7fe650008030 con 0x7fe6600c4fc0 2026-02-13T02:39:38.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.493+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/4032303461 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 msgr2=0x7f8a500b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.493+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/4032303461 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 0x7f8a500b4030 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=13600715338977561173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a4c0075a0 tx=0x7f8a4c02fdc0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.494+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/4032303461 shutdown_connections 2026-02-13T02:39:38.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.494+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/4032303461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a500b4570 0x7f8a50114f00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.494+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/4032303461 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 0x7f8a500b4030 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=13600715338977561173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.495+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/4032303461 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b2a40 0x7f8a500b2e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.495+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/4032303461 >> 10.20.193.78:0/4032303461 conn(0x7f8a50090140 msgr2=0x7f8a500b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.495+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/4032303461 shutdown_connections 2026-02-13T02:39:38.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/4032303461 wait complete. 2026-02-13T02:39:38.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.497+0000 7f8a5eb4a6c0 1 Processor -- start 2026-02-13T02:39:38.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.497+0000 7f8a5eb4a6c0 1 -- start start 2026-02-13T02:39:38.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.495+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe64003f8c0 msgr2=0x7fe64005fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.495+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe64003f8c0 0x7fe64005fd70 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe658004750 tx=0x7fe658009310 comp rx=0 tx=0).stop 2026-02-13T02:39:38.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.495+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c4fc0 msgr2=0x7fe6600d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.495+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c4fc0 0x7fe6600d00d0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe65000b6c0 tx=0x7fe65000bb90 comp rx=0 tx=0).stop 2026-02-13T02:39:38.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 shutdown_connections 2026-02-13T02:39:38.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe64003f8c0 0x7fe64005fd70 unknown :-1 s=CLOSED pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe6600c5970 0x7fe6600d0cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe6600c4fc0 0x7fe6600d00d0 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 --2- 10.20.193.78:0/452472580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe6600c3e40 0x7fe6600cfa80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 >> 10.20.193.78:0/452472580 conn(0x7fe6600a10e0 msgr2=0x7fe6600c14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 shutdown_connections 2026-02-13T02:39:38.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.496+0000 7fe66b6c06c0 1 -- 10.20.193.78:0/452472580 wait complete. 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.497+0000 7f8a5eb4a6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a500b2a40 0x7f8a500a10e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.497+0000 7f8a5eb4a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 0x7f8a50114ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5eb4a6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b4570 0x7f8a500a1920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5eb4a6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500a2520 con 0x7f8a500b2a40 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5eb4a6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500a2690 con 0x7f8a500b3bc0 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5eb4a6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500a2850 con 0x7f8a500b4570 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5e3496c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b4570 0x7f8a500a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5e3496c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b4570 0x7f8a500a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50050/0 (socket says 10.20.193.78:50050) 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5e3496c0 1 -- 10.20.193.78:0/555292223 learned_addr learned my addr 10.20.193.78:0/555292223 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.498+0000 7f8a5d3476c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 0x7f8a50114ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.499+0000 7f8a5db486c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a500b2a40 0x7f8a500a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.499+0000 7f8a5e3496c0 1 -- 10.20.193.78:0/555292223 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 msgr2=0x7f8a50114ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.499+0000 7f8a5e3496c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 0x7f8a50114ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.499+0000 7f8a5e3496c0 1 -- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a500b2a40 msgr2=0x7f8a500a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.499+0000 7f8a5e3496c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a500b2a40 0x7f8a500a10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.499+0000 7f8a5e3496c0 1 -- 10.20.193.78:0/555292223 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5400a660 con 0x7f8a500b4570 2026-02-13T02:39:38.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1967896664 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde410eec0 msgr2=0x7fdde410f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1967896664 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde410eec0 0x7fdde410f2b0 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=13423545510056501598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd8009970 tx=0x7fddd802ed50 comp rx=0 tx=0).stop 2026-02-13T02:39:38.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a5d3476c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 0x7f8a50114ee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:38.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a5db486c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a500b2a40 0x7f8a500a10e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a5e3496c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b4570 0x7f8a500a1920 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a5400c9d0 tx=0x7f8a5400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a46ffd6c0 1 -- 10.20.193.78:0/555292223 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a5400db70 con 0x7f8a500b4570 2026-02-13T02:39:38.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1967896664 shutdown_connections 2026-02-13T02:39:38.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1967896664 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde41109f0 0x7fdde4171380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1967896664 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 0x7fdde41104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1967896664 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde410eec0 0x7fdde410f2b0 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=13423545510056501598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1967896664 >> 10.20.193.78:0/1967896664 conn(0x7fdde40ec5c0 msgr2=0x7fdde410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a46ffd6c0 1 -- 10.20.193.78:0/555292223 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a5400a030 con 0x7f8a500b4570 2026-02-13T02:39:38.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a46ffd6c0 1 -- 10.20.193.78:0/555292223 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a54008440 con 0x7f8a500b4570 2026-02-13T02:39:38.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c0071c0 con 0x7f8a500b4570 2026-02-13T02:39:38.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.500+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a500a2dd0 con 0x7f8a500b4570 2026-02-13T02:39:38.507 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.501+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1967896664 shutdown_connections 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.501+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1967896664 wait complete. 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.502+0000 7fdde8e346c0 1 Processor -- start 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.502+0000 7fdde8e346c0 1 -- start start 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde8e346c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde410eec0 0x7fdde40fcaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde8e346c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 0x7fdde4171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde8e346c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde41109f0 0x7fdde40fd350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde8e346c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdde40fdf30 con 0x7fdde410eec0 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde8e346c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fdde40fe0a0 con 0x7fdde4110040 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde1d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 0x7fdde4171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde1d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 0x7fdde4171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37686/0 (socket says 10.20.193.78:37686) 2026-02-13T02:39:38.508 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde1d746c0 1 -- 10.20.193.78:0/1152323623 learned_addr learned my addr 10.20.193.78:0/1152323623 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdde40fe260 con 0x7fdde41109f0 2026-02-13T02:39:38.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 -- 10.20.193.78:0/3492100876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 msgr2=0x7f93881104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/3492100876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f93881104b0 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=3664941747525463804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f937c009970 tx=0x7f937c02ed50 comp rx=0 tx=0).stop 2026-02-13T02:39:38.509 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a50118b80 con 0x7f8a500b4570 2026-02-13T02:39:38.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 -- 10.20.193.78:0/3492100876 shutdown_connections 2026-02-13T02:39:38.510 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/3492100876 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93881109f0 0x7f9388171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/3492100876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f93881104b0 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=3664941747525463804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/3492100876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f938810eec0 0x7f938810f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 -- 10.20.193.78:0/3492100876 >> 10.20.193.78:0/3492100876 conn(0x7f93880ec5c0 msgr2=0x7f938810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7f938d7f86c0 1 -- 10.20.193.78:0/3492100876 shutdown_connections 2026-02-13T02:39:38.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.503+0000 7fdde2d766c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde41109f0 0x7fdde40fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7fdde25756c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde410eec0 0x7fdde40fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.511 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7fdde1d746c0 1 -- 10.20.193.78:0/1152323623 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde41109f0 msgr2=0x7fdde40fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7fdde1d746c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde41109f0 0x7fdde40fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7fdde1d746c0 1 -- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde410eec0 msgr2=0x7fdde40fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7fdde1d746c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde410eec0 0x7fdde40fcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7fdde1d746c0 1 -- 10.20.193.78:0/1152323623 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd8009590 con 0x7fdde4110040 2026-02-13T02:39:38.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.505+0000 7f938d7f86c0 1 -- 10.20.193.78:0/3492100876 wait complete. 2026-02-13T02:39:38.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.504+0000 7fdde1d746c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 0x7fdde4171380 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc0092e0 tx=0x7fddcc00bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.505+0000 7fddcb7fe6c0 1 -- 10.20.193.78:0/1152323623 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc004250 con 0x7fdde4110040 2026-02-13T02:39:38.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.505+0000 7f8a46ffd6c0 1 -- 10.20.193.78:0/555292223 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f8a54003810 con 0x7f8a500b4570 2026-02-13T02:39:38.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.505+0000 7fddcb7fe6c0 1 -- 10.20.193.78:0/1152323623 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fddcc0043b0 con 0x7fdde4110040 2026-02-13T02:39:38.513 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.505+0000 7fddcb7fe6c0 1 -- 10.20.193.78:0/1152323623 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddcc00cde0 con 0x7fdde4110040 2026-02-13T02:39:38.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.506+0000 7f938d7f86c0 1 Processor -- start 2026-02-13T02:39:38.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.506+0000 7f8a46ffd6c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3003f990 0x7f8a3005fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.514 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.506+0000 7f938d7f86c0 1 -- start start 2026-02-13T02:39:38.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.506+0000 7f8a46ffd6c0 1 -- 10.20.193.78:0/555292223 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8a54052660 con 0x7f8a500b4570 2026-02-13T02:39:38.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.506+0000 7f8a46ffd6c0 1 -- 10.20.193.78:0/555292223 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8a54052a10 con 0x7f8a500b4570 2026-02-13T02:39:38.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f938d7f86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f938810eec0 0x7f9388062c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.515 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.505+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde40fe540 con 0x7fdde4110040 2026-02-13T02:39:38.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.505+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde40fe9d0 con 0x7fdde4110040 2026-02-13T02:39:38.516 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f8a5db486c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3003f990 0x7f8a3005fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f938d7f86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f9388171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f938d7f86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93881109f0 0x7f93880634c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f938d7f86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f93880640f0 con 0x7f938810eec0 2026-02-13T02:39:38.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f8a5db486c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3003f990 0x7f8a3005fe40 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a48004750 tx=0x7f8a48005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f938d7f86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9388064260 con 0x7f93881109f0 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f938d7f86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9388064420 con 0x7f9388110040 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f93867fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f9388171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f93867fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f9388171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50084/0 (socket says 10.20.193.78:50084) 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.507+0000 7f93867fc6c0 1 -- 10.20.193.78:0/1031380372 learned_addr learned my addr 10.20.193.78:0/1031380372 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f93867fc6c0 1 -- 10.20.193.78:0/1031380372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93881109f0 msgr2=0x7f93880634c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f93877fe6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93881109f0 0x7f93880634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f9386ffd6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f938810eec0 0x7f9388062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f93867fc6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93881109f0 0x7f93880634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f93867fc6c0 1 -- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f938810eec0 msgr2=0x7f9388062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f93867fc6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f938810eec0 0x7f9388062c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f93867fc6c0 1 -- 10.20.193.78:0/1031380372 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c009590 con 0x7f9388110040 2026-02-13T02:39:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7f9386ffd6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f938810eec0 0x7f9388062c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.508+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde4175460 con 0x7fdde4110040 2026-02-13T02:39:38.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.510+0000 7fddcb7fe6c0 1 -- 10.20.193.78:0/1152323623 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fddcc0026b0 con 0x7fdde4110040 2026-02-13T02:39:38.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.510+0000 7f93867fc6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f9388171380 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f937c031fd0 tx=0x7f937c0045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.510+0000 7f9363fff6c0 1 -- 10.20.193.78:0/1031380372 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f937c002ba0 con 0x7f9388110040 2026-02-13T02:39:38.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.510+0000 7f9363fff6c0 1 -- 10.20.193.78:0/1031380372 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f937c002d00 con 0x7f9388110040 2026-02-13T02:39:38.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.510+0000 7f9363fff6c0 1 -- 10.20.193.78:0/1031380372 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f937c031340 con 0x7f9388110040 2026-02-13T02:39:38.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.510+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93880646a0 con 0x7f9388110040 2026-02-13T02:39:38.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.510+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9388064aa0 con 0x7f9388110040 2026-02-13T02:39:38.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.511+0000 7fddcb7fe6c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddbc03f990 0x7fddbc05fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.511+0000 7fddcb7fe6c0 1 -- 10.20.193.78:0/1152323623 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fddcc0513d0 con 0x7fdde4110040 2026-02-13T02:39:38.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.512+0000 7fdde25756c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddbc03f990 0x7fddbc05fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.512+0000 7f9363fff6c0 1 -- 10.20.193.78:0/1031380372 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f937c0314d0 con 0x7f9388110040 2026-02-13T02:39:38.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.512+0000 7fdde25756c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddbc03f990 0x7fddbc05fe40 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd80098c0 tx=0x7fddd8031de0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.512+0000 7f9363fff6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f935c03f990 0x7f935c05fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.513+0000 7f9363fff6c0 1 -- 10.20.193.78:0/1031380372 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f937c0757d0 con 0x7f9388110040 2026-02-13T02:39:38.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.513+0000 7fddcb7fe6c0 1 -- 10.20.193.78:0/1152323623 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fddcc011250 con 0x7fdde4110040 2026-02-13T02:39:38.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.519+0000 7f9386ffd6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f935c03f990 0x7f935c05fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.520+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c005310 con 0x7f9388110040 2026-02-13T02:39:38.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.520+0000 7f9386ffd6c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f935c03f990 0x7f935c05fe40 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9374005dc0 tx=0x7f9374005f90 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.523+0000 7f9363fff6c0 1 -- 10.20.193.78:0/1031380372 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f937c007970 con 0x7f9388110040 2026-02-13T02:39:38.552 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.552 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.579 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.580 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.580 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.585 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.664+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fdde4174b00 con 0x7fdde4110040 2026-02-13T02:39:38.678 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.674+0000 7fddcb7fe6c0 1 -- 10.20.193.78:0/1152323623 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v26)=0 v26) ==== 106+0+0 (secure 0 0 0) 0x7fddcc011250 con 0x7fdde4110040 2026-02-13T02:39:38.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.678+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddbc03f990 msgr2=0x7fddbc05fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.678+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddbc03f990 0x7fddbc05fe40 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd80098c0 tx=0x7fddd8031de0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.678+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 msgr2=0x7fdde4171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.678+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 0x7fdde4171380 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc0092e0 tx=0x7fddcc00bc50 comp rx=0 tx=0).stop 2026-02-13T02:39:38.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.692+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 shutdown_connections 2026-02-13T02:39:38.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.692+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddbc03f990 0x7fddbc05fe40 unknown :-1 s=CLOSED pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.692+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdde41109f0 0x7fdde40fd350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.692+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdde4110040 0x7fdde4171380 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.692+0000 7fdde8e346c0 1 --2- 10.20.193.78:0/1152323623 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde410eec0 0x7fdde40fcaf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.692+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 >> 10.20.193.78:0/1152323623 conn(0x7fdde40ec5c0 msgr2=0x7fdde4063360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.693+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 shutdown_connections 2026-02-13T02:39:38.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.694+0000 7fdde8e346c0 1 -- 10.20.193.78:0/1152323623 wait complete. 2026-02-13T02:39:38.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.699+0000 7f73065e86c0 1 -- 10.20.193.78:0/1438474761 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300134920 msgr2=0x7f7300154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.699+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1438474761 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300134920 0x7f7300154da0 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=18088224014175589552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72f0006fd0 tx=0x7f72f002fd20 comp rx=0 tx=0).stop 2026-02-13T02:39:38.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.701+0000 7f73065e86c0 1 -- 10.20.193.78:0/1438474761 shutdown_connections 2026-02-13T02:39:38.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.701+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1438474761 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f73001554e0 0x7f7300175990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.701+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1438474761 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300134920 0x7f7300154da0 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=18088224014175589552 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.701+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1438474761 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7300113f70 0x7f7300134350 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.701+0000 7f73065e86c0 1 -- 10.20.193.78:0/1438474761 >> 10.20.193.78:0/1438474761 conn(0x7f730005b8e0 msgr2=0x7f730005bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.702+0000 7f73065e86c0 1 -- 10.20.193.78:0/1438474761 shutdown_connections 2026-02-13T02:39:38.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.702+0000 7f73065e86c0 1 -- 10.20.193.78:0/1438474761 wait complete. 2026-02-13T02:39:38.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.707+0000 7f73065e86c0 1 Processor -- start 2026-02-13T02:39:38.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.707+0000 7f73065e86c0 1 -- start start 2026-02-13T02:39:38.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.708+0000 7f16570d96c0 1 -- 10.20.193.78:0/1566460019 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 msgr2=0x7f1650134350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.708+0000 7f16570d96c0 1 --2- 10.20.193.78:0/1566460019 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 0x7f1650134350 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=9602130411244513939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c0075a0 tx=0x7f163c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.708+0000 7f16570d96c0 1 -- 10.20.193.78:0/1566460019 shutdown_connections 2026-02-13T02:39:38.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.708+0000 7f16570d96c0 1 --2- 10.20.193.78:0/1566460019 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16501554e0 0x7f1650175990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.709+0000 7f16570d96c0 1 --2- 10.20.193.78:0/1566460019 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 0x7f1650154da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.709+0000 7f16570d96c0 1 --2- 10.20.193.78:0/1566460019 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 0x7f1650134350 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=9602130411244513939 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.709+0000 7f16570d96c0 1 -- 10.20.193.78:0/1566460019 >> 10.20.193.78:0/1566460019 conn(0x7f165005b8e0 msgr2=0x7f165005bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.709+0000 7f16570d96c0 1 -- 10.20.193.78:0/1566460019 shutdown_connections 2026-02-13T02:39:38.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.709+0000 7f16570d96c0 1 -- 10.20.193.78:0/1566460019 wait complete. 2026-02-13T02:39:38.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.710+0000 7f16570d96c0 1 Processor -- start 2026-02-13T02:39:38.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f16570d96c0 1 -- start start 2026-02-13T02:39:38.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f16570d96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 0x7f1650154da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f16570d96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 0x7f1650175960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f1654e4a6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 0x7f1650154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f164ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 0x7f1650175960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f164ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 0x7f1650175960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47630/0 (socket says 10.20.193.78:47630) 2026-02-13T02:39:38.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f1654e4a6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 0x7f1650154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50128/0 (socket says 10.20.193.78:50128) 2026-02-13T02:39:38.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f164ffff6c0 1 -- 10.20.193.78:0/3830377176 learned_addr learned my addr 10.20.193.78:0/3830377176 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f16570d96c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16501554e0 0x7f1650114910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.713+0000 7f16570d96c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16501150a0 con 0x7f1650134920 2026-02-13T02:39:38.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.713+0000 7f16570d96c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1650115210 con 0x7f16501554e0 2026-02-13T02:39:38.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.713+0000 7f16570d96c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16501157f0 con 0x7f1650113f70 2026-02-13T02:39:38.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.713+0000 7f165564b6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16501554e0 0x7f1650114910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f164ffff6c0 1 -- 10.20.193.78:0/3830377176 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 msgr2=0x7f1650154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f164ffff6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 0x7f1650154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f164ffff6c0 1 -- 10.20.193.78:0/3830377176 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16501554e0 msgr2=0x7f1650114910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f164ffff6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16501554e0 0x7f1650114910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f164ffff6c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1640009590 con 0x7f1650134920 2026-02-13T02:39:38.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f165564b6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16501554e0 0x7f1650114910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.715+0000 7f164ffff6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 0x7f1650175960 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1640004750 tx=0x7f164000bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.716+0000 7f164dffb6c0 1 -- 10.20.193.78:0/3830377176 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1640004290 con 0x7f1650134920 2026-02-13T02:39:38.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f73065e86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300113f70 0x7f7300154d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f73065e86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7300134920 0x7f730010d880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f73065e86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73001554e0 0x7f730010dfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f72ff7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7300134920 0x7f730010d880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f72ff7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7300134920 0x7f730010d880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50114/0 (socket says 10.20.193.78:50114) 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f72ff7fe6c0 1 -- 10.20.193.78:0/1452458963 learned_addr learned my addr 10.20.193.78:0/1452458963 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f730010ebd0 con 0x7f73001554e0 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f730010ed40 con 0x7f7300113f70 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f730010ef00 con 0x7f7300134920 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f72fffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300113f70 0x7f7300154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.711+0000 7f7304b5a6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73001554e0 0x7f730010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72ff7fe6c0 1 -- 10.20.193.78:0/1452458963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300113f70 msgr2=0x7f7300154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72ff7fe6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300113f70 0x7f7300154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72ff7fe6c0 1 -- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73001554e0 msgr2=0x7f730010dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72ff7fe6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73001554e0 0x7f730010dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72ff7fe6c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e80071c0 con 0x7f7300134920 2026-02-13T02:39:38.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72fffff6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300113f70 0x7f7300154d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:38.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f7304b5a6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73001554e0 0x7f730010dfd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.716+0000 7f164dffb6c0 1 -- 10.20.193.78:0/3830377176 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1640009030 con 0x7f1650134920 2026-02-13T02:39:38.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.716+0000 7f164dffb6c0 1 -- 10.20.193.78:0/3830377176 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16400071c0 con 0x7f1650134920 2026-02-13T02:39:38.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.716+0000 7f16570d96c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164400a5b0 con 0x7f1650134920 2026-02-13T02:39:38.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72ff7fe6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7300134920 0x7f730010d880 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72f0002780 tx=0x7f72f0003aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72fd7fa6c0 1 -- 10.20.193.78:0/1452458963 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72f0005560 con 0x7f7300134920 2026-02-13T02:39:38.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72fd7fa6c0 1 -- 10.20.193.78:0/1452458963 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f72f00086a0 con 0x7f7300134920 2026-02-13T02:39:38.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f000a5b0 con 0x7f7300134920 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730010f470 con 0x7f7300134920 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.712+0000 7f72fd7fa6c0 1 -- 10.20.193.78:0/1452458963 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72f0039460 con 0x7f7300134920 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f72fd7fa6c0 1 -- 10.20.193.78:0/1452458963 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f72f00081c0 con 0x7f7300134920 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.714+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730010f750 con 0x7f7300134920 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.715+0000 7f72fd7fa6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72d803f990 0x7f72d805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.715+0000 7f72fd7fa6c0 1 -- 10.20.193.78:0/1452458963 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f72f0076750 con 0x7f7300134920 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.715+0000 7f72fffff6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72d803f990 0x7f72d805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.716+0000 7f72fffff6c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72d803f990 0x7f72d805fe40 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72e8005b40 tx=0x7f72e800ad10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.717+0000 7f16570d96c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163c0071c0 con 0x7f1650134920 2026-02-13T02:39:38.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.718+0000 7f72fd7fa6c0 1 -- 10.20.193.78:0/1452458963 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f72f0034890 con 0x7f7300134920 2026-02-13T02:39:38.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.719+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16501787a0 con 0x7f1650134920 2026-02-13T02:39:38.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.721+0000 7f164dffb6c0 1 -- 10.20.193.78:0/3830377176 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f164000c900 con 0x7f1650134920 2026-02-13T02:39:38.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.722+0000 7f164dffb6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f163003f940 0x7f163005fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.722+0000 7f164dffb6c0 1 -- 10.20.193.78:0/3830377176 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f1640051620 con 0x7f1650134920 2026-02-13T02:39:38.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.723+0000 7f164dffb6c0 1 -- 10.20.193.78:0/3830377176 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f16400043f0 con 0x7f1650134920 2026-02-13T02:39:38.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.726+0000 7f1654e4a6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f163003f940 0x7f163005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.732+0000 7f1654e4a6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f163003f940 0x7f163005fdf0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c0308c0 tx=0x7f163c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.741+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f8a500008e0 con 0x7f8a500b4570 2026-02-13T02:39:38.761 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.761 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial078') 2026-02-13T02:39:38.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.758+0000 7f8a46ffd6c0 1 -- 10.20.193.78:0/555292223 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v27)=0 v27) ==== 111+0+0 (secure 0 0 0) 0x7f8a54010640 con 0x7f8a500b4570 2026-02-13T02:39:38.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.762+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3003f990 msgr2=0x7f8a3005fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.762+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3003f990 0x7f8a3005fe40 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a48004750 tx=0x7f8a48005f10 comp rx=0 tx=0).stop 2026-02-13T02:39:38.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.762+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b4570 msgr2=0x7f8a500a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.762+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b4570 0x7f8a500a1920 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a5400c9d0 tx=0x7f8a5400cea0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.763+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/1947889320 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114ee0 msgr2=0x7ff1fc115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.763+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/1947889320 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc115360 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=4112724699224531158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1ec01ad80 tx=0x7ff1ec040160 comp rx=0 tx=0).stop 2026-02-13T02:39:38.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 shutdown_connections 2026-02-13T02:39:38.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3003f990 0x7f8a3005fe40 unknown :-1 s=CLOSED pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a500b4570 0x7f8a500a1920 unknown :-1 s=CLOSED pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a500b3bc0 0x7f8a50114ee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 --2- 10.20.193.78:0/555292223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a500b2a40 0x7f8a500a10e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 >> 10.20.193.78:0/555292223 conn(0x7f8a50090140 msgr2=0x7f8a500930e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 shutdown_connections 2026-02-13T02:39:38.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.768+0000 7f8a5eb4a6c0 1 -- 10.20.193.78:0/555292223 wait complete. 2026-02-13T02:39:38.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.782+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/1947889320 shutdown_connections 2026-02-13T02:39:38.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.783+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/1947889320 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc115360 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=4112724699224531158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.783+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/1947889320 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc114350 0x7ff1fc1147c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.783+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/1947889320 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc05e700 0x7ff1fc113dc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.783+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/1947889320 >> 10.20.193.78:0/1947889320 conn(0x7ff1fc05b720 msgr2=0x7ff1fc05bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.783+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/1947889320 shutdown_connections 2026-02-13T02:39:38.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.783+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/1947889320 wait complete. 2026-02-13T02:39:38.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.786+0000 7ff201b4c6c0 1 Processor -- start 2026-02-13T02:39:38.792 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.790+0000 7ff201b4c6c0 1 -- start start 2026-02-13T02:39:38.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.791+0000 7ff201b4c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc05e700 0x7ff1fc0fece0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.791+0000 7ff201b4c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114350 0x7ff1fc0ff330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.791+0000 7ff201b4c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc0ffed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.791+0000 7ff201b4c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc100660 con 0x7ff1fc114350 2026-02-13T02:39:38.793 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.791+0000 7ff201b4c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc1007d0 con 0x7ff1fc114ee0 2026-02-13T02:39:38.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.791+0000 7ff201b4c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1fc100990 con 0x7ff1fc05e700 2026-02-13T02:39:38.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.792+0000 7ff1fb7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc05e700 0x7ff1fc0fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.794 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.792+0000 7ff1fbfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc0ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.792+0000 7ff1faffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114350 0x7ff1fc0ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.795 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.792+0000 7ff1fb7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc05e700 0x7ff1fc0fece0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50144/0 (socket says 10.20.193.78:50144) 2026-02-13T02:39:38.805 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.792+0000 7ff1fbfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc0ffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37738/0 (socket says 10.20.193.78:37738) 2026-02-13T02:39:38.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.792+0000 7ff1fbfff6c0 1 -- 10.20.193.78:0/3565659667 learned_addr learned my addr 10.20.193.78:0/3565659667 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.793+0000 7ff1fbfff6c0 1 -- 10.20.193.78:0/3565659667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc05e700 msgr2=0x7ff1fc0fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.792+0000 7ff1faffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114350 0x7ff1fc0ff330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47642/0 (socket says 10.20.193.78:47642) 2026-02-13T02:39:38.806 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.798+0000 7ff1fbfff6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc05e700 0x7ff1fc0fece0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.798+0000 7ff1fbfff6c0 1 -- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114350 msgr2=0x7ff1fc0ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.798+0000 7ff1fbfff6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114350 0x7ff1fc0ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.798+0000 7ff1fbfff6c0 1 -- 10.20.193.78:0/3565659667 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec01a9a0 con 0x7ff1fc114ee0 2026-02-13T02:39:38.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.798+0000 7ff1faffd6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114350 0x7ff1fc0ff330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.798+0000 7ff1fb7fe6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc05e700 0x7ff1fc0fece0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:38.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.798+0000 7ff1fbfff6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc0ffed0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1ec002fd0 tx=0x7ff1ec004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.811+0000 7ff1f8ff96c0 1 -- 10.20.193.78:0/3565659667 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1ec004a80 con 0x7ff1fc114ee0 2026-02-13T02:39:38.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.812+0000 7ff1f8ff96c0 1 -- 10.20.193.78:0/3565659667 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff1ec0027f0 con 0x7ff1fc114ee0 2026-02-13T02:39:38.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.812+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1fc100c10 con 0x7ff1fc114ee0 2026-02-13T02:39:38.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.812+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1fc17a640 con 0x7ff1fc114ee0 2026-02-13T02:39:38.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.812+0000 7ff1f8ff96c0 1 -- 10.20.193.78:0/3565659667 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1ec0079c0 con 0x7ff1fc114ee0 2026-02-13T02:39:38.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.816+0000 7ff1f8ff96c0 1 -- 10.20.193.78:0/3565659667 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7ff1ec007b50 con 0x7ff1fc114ee0 2026-02-13T02:39:38.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.817+0000 7ff1f8ff96c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff1cc03f990 0x7ff1cc05fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.817+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1fc1197d0 con 0x7ff1fc114ee0 2026-02-13T02:39:38.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.818+0000 7ff1f8ff96c0 1 -- 10.20.193.78:0/3565659667 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ff1ec0759c0 con 0x7ff1fc114ee0 2026-02-13T02:39:38.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.818+0000 7ff1fb7fe6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff1cc03f990 0x7ff1cc05fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.820+0000 7ff1fb7fe6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff1cc03f990 0x7ff1cc05fe40 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f0005880 tx=0x7ff1f0007f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.821+0000 7ff1f8ff96c0 1 -- 10.20.193.78:0/3565659667 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1ec007e30 con 0x7ff1fc114ee0 2026-02-13T02:39:38.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.865+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f16501798b0 con 0x7f1650134920 2026-02-13T02:39:38.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.868+0000 7f164dffb6c0 1 -- 10.20.193.78:0/3830377176 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v28)=0 v28) ==== 133+0+0 (secure 0 0 0) 0x7f16400108b0 con 0x7f1650134920 2026-02-13T02:39:38.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.874+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f163003f940 msgr2=0x7f163005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.874+0000 7f16277fe6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f163003f940 0x7f163005fdf0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f163c0308c0 tx=0x7f163c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.874+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 msgr2=0x7f1650175960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.874+0000 7f16277fe6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 0x7f1650175960 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1640004750 tx=0x7f164000bc90 comp rx=0 tx=0).stop 2026-02-13T02:39:38.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.875+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 shutdown_connections 2026-02-13T02:39:38.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.875+0000 7f16277fe6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f163003f940 0x7f163005fdf0 unknown :-1 s=CLOSED pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.875+0000 7f16277fe6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16501554e0 0x7f1650114910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.875+0000 7f16277fe6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1650134920 0x7f1650175960 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.875+0000 7f16277fe6c0 1 --2- 10.20.193.78:0/3830377176 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1650113f70 0x7f1650154da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.875+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 >> 10.20.193.78:0/3830377176 conn(0x7f165005b8e0 msgr2=0x7f165017c980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.876+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 shutdown_connections 2026-02-13T02:39:38.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.876+0000 7f16277fe6c0 1 -- 10.20.193.78:0/3830377176 wait complete. 2026-02-13T02:39:38.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.883+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2880014430 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 msgr2=0x7fc378175990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.883+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2880014430 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 0x7fc378175990 secure :-1 s=READY pgs=29 gs=2 cs=0 l=1 c_cookie=11341843401353688882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc36800aa40 tx=0x7fc368034380 comp rx=0 tx=0).stop 2026-02-13T02:39:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.884+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2880014430 shutdown_connections 2026-02-13T02:39:38.886 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.884+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2880014430 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 0x7fc378175990 unknown :-1 s=CLOSED pgs=29 gs=2 cs=0 l=1 c_cookie=11341843401353688882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.884+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2880014430 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 0x7fc378154da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.884+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2880014430 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc378113f70 0x7fc378134350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.884+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2880014430 >> 10.20.193.78:0/2880014430 conn(0x7fc37805b8e0 msgr2=0x7fc37805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.885+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2880014430 shutdown_connections 2026-02-13T02:39:38.887 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.885+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2880014430 wait complete. 2026-02-13T02:39:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.886+0000 7fc37cfbb6c0 1 Processor -- start 2026-02-13T02:39:38.888 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.886+0000 7fc37cfbb6c0 1 -- start start 2026-02-13T02:39:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.887+0000 7fc37cfbb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc378113f70 0x7fc378154da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.887+0000 7fc37cfbb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 0x7fc3781758c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.887+0000 7fc37cfbb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 0x7fc3780ff9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.887+0000 7fc37cfbb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc378100140 con 0x7fc378134920 2026-02-13T02:39:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.887+0000 7fc37cfbb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc3781002b0 con 0x7fc378113f70 2026-02-13T02:39:38.889 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.887+0000 7fc37cfbb6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc378100990 con 0x7fc3781554e0 2026-02-13T02:39:38.890 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.887+0000 7fc3765756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc378113f70 0x7fc378154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc3765756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc378113f70 0x7fc378154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37764/0 (socket says 10.20.193.78:37764) 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc376d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 0x7fc3780ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 0x7fc3781758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 0x7fc3781758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47658/0 (socket says 10.20.193.78:47658) 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 -- 10.20.193.78:0/2184544306 learned_addr learned my addr 10.20.193.78:0/2184544306 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 -- 10.20.193.78:0/2184544306 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 msgr2=0x7fc3780ff9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 0x7fc3780ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 -- 10.20.193.78:0/2184544306 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc378113f70 msgr2=0x7fc378154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc378113f70 0x7fc378154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 -- 10.20.193.78:0/2184544306 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36800a660 con 0x7fc378134920 2026-02-13T02:39:38.891 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.888+0000 7fc375d746c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 0x7fc3781758c0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc36000c7b0 tx=0x7fc36000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.889+0000 7fc35f7fe6c0 1 -- 10.20.193.78:0/2184544306 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc360004a80 con 0x7fc378134920 2026-02-13T02:39:38.892 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.889+0000 7fc35f7fe6c0 1 -- 10.20.193.78:0/2184544306 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc360008020 con 0x7fc378134920 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.889+0000 7fc35f7fe6c0 1 -- 10.20.193.78:0/2184544306 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc36000a150 con 0x7fc378134920 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.889+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc378100c70 con 0x7fc378134920 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.889+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc378101100 con 0x7fc378134920 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.890+0000 7fc35f7fe6c0 1 -- 10.20.193.78:0/2184544306 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fc3600071c0 con 0x7fc378134920 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.890+0000 7fc35f7fe6c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc35003f990 0x7fc35005fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.890+0000 7fc35f7fe6c0 1 -- 10.20.193.78:0/2184544306 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc360004c70 con 0x7fc378134920 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.891+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c005310 con 0x7fc378134920 2026-02-13T02:39:38.893 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.891+0000 7fc3765756c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc35003f990 0x7fc35005fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.894 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.892+0000 7fc3765756c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc35003f990 0x7fc35005fe40 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc36c004750 tx=0x7fc36c009b10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.893+0000 7fc35f7fe6c0 1 -- 10.20.193.78:0/2184544306 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc36000f400 con 0x7fc378134920 2026-02-13T02:39:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.897+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/1863757008 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 msgr2=0x7fb5e80b5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.897+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/1863757008 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80b5e10 secure :-1 s=READY pgs=18 gs=3 cs=0 l=1 c_cookie=2600025556133716826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d80098a0 tx=0x7fb5d802ec90 comp rx=0 tx=0).stop 2026-02-13T02:39:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.900+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/1863757008 shutdown_connections 2026-02-13T02:39:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.901+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/1863757008 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b6350 0x7fb5e8116ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.901+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/1863757008 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80b5e10 unknown :-1 s=CLOSED pgs=18 gs=3 cs=0 l=1 c_cookie=2600025556133716826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.901+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/1863757008 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb5e80b4820 0x7fb5e80b4c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.901+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/1863757008 >> 10.20.193.78:0/1863757008 conn(0x7fb5e8091f60 msgr2=0x7fb5e80b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.901+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/1863757008 shutdown_connections 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.901+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/1863757008 wait complete. 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.902+0000 7fb5f5d186c0 1 Processor -- start 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.902+0000 7fb5f5d186c0 1 -- start start 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.903+0000 7fb5f5d186c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b4820 0x7fb5e8125080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.903+0000 7fb5f5d186c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80f6cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.903+0000 7fb5e7fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.903+0000 7fb5e7fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80f6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37780/0 (socket says 10.20.193.78:37780) 2026-02-13T02:39:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.903+0000 7fb5f4d166c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b4820 0x7fb5e8125080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.905+0000 7fb5f4d166c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b4820 0x7fb5e8125080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50168/0 (socket says 10.20.193.78:50168) 2026-02-13T02:39:38.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.905+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f7300179ab0 con 0x7f7300134920 2026-02-13T02:39:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5f5d186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb5e80b6350 0x7fb5e80f7440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80f7bd0 con 0x7fb5e80b6350 2026-02-13T02:39:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5e7fff6c0 1 -- 10.20.193.78:0/2216327248 learned_addr learned my addr 10.20.193.78:0/2216327248 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80f7d40 con 0x7fb5e80b59a0 2026-02-13T02:39:38.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e80f7f00 con 0x7fb5e80b4820 2026-02-13T02:39:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5e7fff6c0 1 -- 10.20.193.78:0/2216327248 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b4820 msgr2=0x7fb5e8125080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5e7fff6c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b4820 0x7fb5e8125080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5e7fff6c0 1 -- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb5e80b6350 msgr2=0x7fb5e80f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5e7fff6c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb5e80b6350 0x7fb5e80f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.906+0000 7fb5e7fff6c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d80094c0 con 0x7fb5e80b59a0 2026-02-13T02:39:38.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.907+0000 7fb5f4d166c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b4820 0x7fb5e8125080 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:39:38.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.909+0000 7fb5e7fff6c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80f6cf0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d80097f0 tx=0x7fb5d8005d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.909+0000 7f72fd7fa6c0 1 -- 10.20.193.78:0/1452458963 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f72f0034890 con 0x7f7300134920 2026-02-13T02:39:38.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.909+0000 7fb5e5ffb6c0 1 -- 10.20.193.78:0/2216327248 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5d8002b90 con 0x7fb5e80b59a0 2026-02-13T02:39:38.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.909+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e80f8180 con 0x7fb5e80b59a0 2026-02-13T02:39:38.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.909+0000 7fb5e5ffb6c0 1 -- 10.20.193.78:0/2216327248 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb5d80076a0 con 0x7fb5e80b59a0 2026-02-13T02:39:38.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.910+0000 7fb5e5ffb6c0 1 -- 10.20.193.78:0/2216327248 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5d8002b90 con 0x7fb5e80b59a0 2026-02-13T02:39:38.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.914+0000 7fb5e5ffb6c0 1 -- 10.20.193.78:0/2216327248 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fb5d8002cf0 con 0x7fb5e80b59a0 2026-02-13T02:39:38.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.914+0000 7fb5e5ffb6c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5c003f9a0 0x7fb5c005fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.915+0000 7fb5f4d166c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5c003f9a0 0x7fb5c005fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.915+0000 7fb5f4d166c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5c003f9a0 0x7fb5c005fe50 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e0005980 tx=0x7fb5e0009290 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.916+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e80f8650 con 0x7fb5e80b59a0 2026-02-13T02:39:38.918 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.916+0000 7fb5e5ffb6c0 1 -- 10.20.193.78:0/2216327248 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fb5d8049900 con 0x7fb5e80b59a0 2026-02-13T02:39:38.920 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.918+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e8118b00 con 0x7fb5e80b59a0 2026-02-13T02:39:38.921 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.919+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f934c005b40 con 0x7f9388110040 2026-02-13T02:39:38.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.918+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72d803f990 msgr2=0x7f72d805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.918+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72d803f990 0x7f72d805fe40 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72e8005b40 tx=0x7f72e800ad10 comp rx=0 tx=0).stop 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.918+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7300134920 msgr2=0x7f730010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.918+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7300134920 0x7f730010d880 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72f0002780 tx=0x7f72f0003aa0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.919+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 shutdown_connections 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.919+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72d803f990 0x7f72d805fe40 unknown :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.919+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73001554e0 0x7f730010dfd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.919+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7300134920 0x7f730010d880 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.919+0000 7f73065e86c0 1 --2- 10.20.193.78:0/1452458963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7300113f70 0x7f7300154d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.919+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 >> 10.20.193.78:0/1452458963 conn(0x7f730005b8e0 msgr2=0x7f7300114340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.920+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 shutdown_connections 2026-02-13T02:39:38.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.920+0000 7f73065e86c0 1 -- 10.20.193.78:0/1452458963 wait complete. 2026-02-13T02:39:38.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.922+0000 7fb5e5ffb6c0 1 -- 10.20.193.78:0/2216327248 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5d8032400 con 0x7fb5e80b59a0 2026-02-13T02:39:38.934 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.932+0000 7f9363fff6c0 1 -- 10.20.193.78:0/1031380372 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v30)=0 v30) ==== 119+0+0 (secure 0 0 0) 0x7f937c034040 con 0x7f9388110040 2026-02-13T02:39:38.961 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.953+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f935c03f990 msgr2=0x7f935c05fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.953+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f935c03f990 0x7f935c05fe40 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9374005dc0 tx=0x7f9374005f90 comp rx=0 tx=0).stop 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.953+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 msgr2=0x7f9388171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.953+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f9388171380 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f937c031fd0 tx=0x7f937c0045f0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.959+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 shutdown_connections 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.959+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f935c03f990 0x7f935c05fe40 unknown :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.959+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93881109f0 0x7f93880634c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.959+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9388110040 0x7f9388171380 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.959+0000 7f938d7f86c0 1 --2- 10.20.193.78:0/1031380372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f938810eec0 0x7f9388062c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.959+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 >> 10.20.193.78:0/1031380372 conn(0x7f93880ec5c0 msgr2=0x7f93880ef630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.959+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 shutdown_connections 2026-02-13T02:39:38.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.960+0000 7f938d7f86c0 1 -- 10.20.193.78:0/1031380372 wait complete. 2026-02-13T02:39:38.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.952+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7ff1fc17aa20 con 0x7ff1fc114ee0 2026-02-13T02:39:38.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.960+0000 7ff1f8ff96c0 1 -- 10.20.193.78:0/3565659667 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7ff1ec00c040 con 0x7ff1fc114ee0 2026-02-13T02:39:38.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.969+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/425307166 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58113dc0 msgr2=0x7f8e581341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.969+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/425307166 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58113dc0 0x7f8e581341a0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=11875636658211297588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e48009970 tx=0x7f8e4802ed70 comp rx=0 tx=0).stop 2026-02-13T02:39:38.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.986+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/425307166 shutdown_connections 2026-02-13T02:39:38.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.986+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/425307166 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8e58155340 0x7f8e581757f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.986+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/425307166 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8e581347c0 0x7f8e58154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.986+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/425307166 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58113dc0 0x7f8e581341a0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=11875636658211297588 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.986+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/425307166 >> 10.20.193.78:0/425307166 conn(0x7f8e5805b720 msgr2=0x7f8e5805bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.987+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/425307166 shutdown_connections 2026-02-13T02:39:38.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.987+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/425307166 wait complete. 2026-02-13T02:39:38.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.988+0000 7f8e5d3446c0 1 Processor -- start 2026-02-13T02:39:38.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.988+0000 7f8e5d3446c0 1 -- start start 2026-02-13T02:39:38.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.988+0000 7f8e5d3446c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8e58113dc0 0x7f8e58154c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.989+0000 7f8e5d3446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8e581347c0 0x7f8e581757f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.989+0000 7f8e5d3446c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58155340 0x7f8e580ffa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:38.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.989+0000 7f8e577fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8e581347c0 0x7f8e581757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.989+0000 7f8e5d3446c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581001e0 con 0x7f8e58113dc0 2026-02-13T02:39:38.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.989+0000 7f8e5cb436c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58155340 0x7f8e580ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.989+0000 7f8e5cb436c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58155340 0x7f8e580ffa50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37788/0 (socket says 10.20.193.78:37788) 2026-02-13T02:39:38.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.989+0000 7f8e5cb436c0 1 -- 10.20.193.78:0/2951538663 learned_addr learned my addr 10.20.193.78:0/2951538663 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:38.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.990+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58100350 con 0x7f8e58155340 2026-02-13T02:39:38.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.990+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58100970 con 0x7f8e581347c0 2026-02-13T02:39:38.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.991+0000 7f8e57fff6c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8e58113dc0 0x7f8e58154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:38.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.991+0000 7f8e5cb436c0 1 -- 10.20.193.78:0/2951538663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8e581347c0 msgr2=0x7f8e581757f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.991+0000 7f8e5cb436c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8e581347c0 0x7f8e581757f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.991+0000 7f8e5cb436c0 1 -- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8e58113dc0 msgr2=0x7f8e58154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.991+0000 7f8e5cb436c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8e58113dc0 0x7f8e58154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.991+0000 7f8e5cb436c0 1 -- 10.20.193.78:0/2951538663 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c010600 con 0x7f8e58155340 2026-02-13T02:39:38.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7f8e577fe6c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8e581347c0 0x7f8e581757f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:39:38.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7f8e57fff6c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8e58113dc0 0x7f8e58154c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:39:38.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.993+0000 7f8e5cb436c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58155340 0x7f8e580ffa50 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e4400b9a0 tx=0x7f8e4400be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff1cc03f990 msgr2=0x7ff1cc05fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff1cc03f990 0x7ff1cc05fe40 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f0005880 tx=0x7ff1f0007f10 comp rx=0 tx=0).stop 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc114ee0 msgr2=0x7ff1fc0ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc0ffed0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1ec002fd0 tx=0x7ff1ec004270 comp rx=0 tx=0).stop 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 shutdown_connections 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff1cc03f990 0x7ff1cc05fe40 unknown :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1fc114ee0 0x7ff1fc0ffed0 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff1fc114350 0x7ff1fc0ff330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 --2- 10.20.193.78:0/3565659667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1fc05e700 0x7ff1fc0fece0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.992+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 >> 10.20.193.78:0/3565659667 conn(0x7ff1fc05b720 msgr2=0x7ff1fc0f51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.993+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 shutdown_connections 2026-02-13T02:39:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.993+0000 7ff201b4c6c0 1 -- 10.20.193.78:0/3565659667 wait complete. 2026-02-13T02:39:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.994+0000 7f8e557fa6c0 1 -- 10.20.193.78:0/2951538663 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e44004030 con 0x7f8e58155340 2026-02-13T02:39:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.994+0000 7f8e557fa6c0 1 -- 10.20.193.78:0/2951538663 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8e440026b0 con 0x7f8e58155340 2026-02-13T02:39:38.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.994+0000 7f8e557fa6c0 1 -- 10.20.193.78:0/2951538663 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e4400cda0 con 0x7f8e58155340 2026-02-13T02:39:38.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.994+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e440081d0 con 0x7f8e58155340 2026-02-13T02:39:38.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.994+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e48009590 con 0x7f8e58155340 2026-02-13T02:39:38.999 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.997+0000 7f8e557fa6c0 1 -- 10.20.193.78:0/2951538663 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f8e44004190 con 0x7f8e58155340 2026-02-13T02:39:39.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.998+0000 7f8e557fa6c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8e2c03f990 0x7f8e2c05fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.998+0000 7f8e557fa6c0 1 -- 10.20.193.78:0/2951538663 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8e44051530 con 0x7f8e58155340 2026-02-13T02:39:39.000 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:38.999+0000 7f8e57fff6c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8e2c03f990 0x7f8e2c05fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.000+0000 7f8e57fff6c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8e2c03f990 0x7f8e2c05fe40 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e480023e0 tx=0x7f8e48005c80 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:39.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.009+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc33c005b40 con 0x7fc378134920 2026-02-13T02:39:39.014 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.012+0000 7fc35f7fe6c0 1 -- 10.20.193.78:0/2184544306 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7fc36000e040 con 0x7fc378134920 2026-02-13T02:39:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.014+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc35003f990 msgr2=0x7fc35005fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc35003f990 0x7fc35005fe40 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc36c004750 tx=0x7fc36c009b10 comp rx=0 tx=0).stop 2026-02-13T02:39:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 msgr2=0x7fc3781758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 0x7fc3781758c0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc36000c7b0 tx=0x7fc36000cc80 comp rx=0 tx=0).stop 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 shutdown_connections 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc35003f990 0x7fc35005fe40 unknown :-1 s=CLOSED pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc3781554e0 0x7fc3780ff9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc378134920 0x7fc3781758c0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 --2- 10.20.193.78:0/2184544306 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc378113f70 0x7fc378154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.015+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 >> 10.20.193.78:0/2184544306 conn(0x7fc37805b8e0 msgr2=0x7fc3780f61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.016+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 shutdown_connections 2026-02-13T02:39:39.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.016+0000 7fc37cfbb6c0 1 -- 10.20.193.78:0/2184544306 wait complete. 2026-02-13T02:39:39.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.017+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1c005310 con 0x7f8e58155340 2026-02-13T02:39:39.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.020+0000 7f8e557fa6c0 1 -- 10.20.193.78:0/2951538663 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8e44008790 con 0x7f8e58155340 2026-02-13T02:39:39.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.028+0000 7f6ef5fc76c0 1 -- 10.20.193.78:0/1246208868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8007040 msgr2=0x7f6ee80074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.028+0000 7f6ef5fc76c0 1 --2- 10.20.193.78:0/1246208868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8007040 0x7f6ee80074b0 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=2644777434041547666 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ee4009b00 tx=0x7f6ee402eeb0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.033+0000 7f6ef5fc76c0 1 -- 10.20.193.78:0/1246208868 shutdown_connections 2026-02-13T02:39:39.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.033+0000 7f6ef5fc76c0 1 --2- 10.20.193.78:0/1246208868 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 0x7f6ee8008350 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.033+0000 7f6ef5fc76c0 1 --2- 10.20.193.78:0/1246208868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8007040 0x7f6ee80074b0 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=2644777434041547666 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.033+0000 7f6ef5fc76c0 1 --2- 10.20.193.78:0/1246208868 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ee8005ec0 0x7f6ee80062b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.033+0000 7f6ef5fc76c0 1 -- 10.20.193.78:0/1246208868 >> 10.20.193.78:0/1246208868 conn(0x7f6ee80a10e0 msgr2=0x7f6ee80c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.033+0000 7f6ef5fc76c0 1 -- 10.20.193.78:0/1246208868 shutdown_connections 2026-02-13T02:39:39.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.033+0000 7f6ef5fc76c0 1 -- 10.20.193.78:0/1246208868 wait complete. 2026-02-13T02:39:39.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.034+0000 7f6ef5fc76c0 1 Processor -- start 2026-02-13T02:39:39.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.034+0000 7f6ef5fc76c0 1 -- start start 2026-02-13T02:39:39.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.034+0000 7f6ef5fc76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8005ec0 0x7f6ee816dbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.034+0000 7f6ef5fc76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ee8007040 0x7f6ee816e220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.034+0000 7f6ef5fc76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 0x7f6ee816ee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef4fc56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8005ec0 0x7f6ee816dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef5fc76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee816f5a0 con 0x7f6ee8005ec0 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef5fc76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee816f710 con 0x7f6ee80079f0 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef5fc76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee816f8d0 con 0x7f6ee8007040 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef4fc56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8005ec0 0x7f6ee816dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47696/0 (socket says 10.20.193.78:47696) 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 0x7f6ee816ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 0x7f6ee816ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37802/0 (socket says 10.20.193.78:37802) 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 -- 10.20.193.78:0/965124298 learned_addr learned my addr 10.20.193.78:0/965124298 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 -- 10.20.193.78:0/965124298 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ee8007040 msgr2=0x7f6ee816e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ee8007040 0x7f6ee816e220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 -- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8005ec0 msgr2=0x7f6ee816dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8005ec0 0x7f6ee816dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 -- 10.20.193.78:0/965124298 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef004beb0 con 0x7f6ee80079f0 2026-02-13T02:39:39.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.035+0000 7f6ef57c66c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 0x7f6ee816ee10 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ef003b370 tx=0x7f6ef003b180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:39.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.036+0000 7f6eedffb6c0 1 -- 10.20.193.78:0/965124298 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ef0063980 con 0x7f6ee80079f0 2026-02-13T02:39:39.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.036+0000 7f6eedffb6c0 1 -- 10.20.193.78:0/965124298 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6ef005c030 con 0x7f6ee80079f0 2026-02-13T02:39:39.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.037+0000 7f6ef5fc76c0 1 -- 10.20.193.78:0/965124298 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee40094c0 con 0x7f6ee80079f0 2026-02-13T02:39:39.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.037+0000 7f6eedffb6c0 1 -- 10.20.193.78:0/965124298 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ef0065070 con 0x7f6ee80079f0 2026-02-13T02:39:39.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.037+0000 7f6ef5fc76c0 1 -- 10.20.193.78:0/965124298 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee81d0060 con 0x7f6ee80079f0 2026-02-13T02:39:39.044 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.042+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb4005310 con 0x7f6ee80079f0 2026-02-13T02:39:39.045 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.045 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3023135184' entity='client.admin' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.046 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.047 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.047 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.047 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.047 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.044+0000 7f6eedffb6c0 1 -- 10.20.193.78:0/965124298 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f6ef005a640 con 0x7f6ee80079f0 2026-02-13T02:39:39.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.045+0000 7f6eedffb6c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ec803f990 0x7f6ec805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.045+0000 7f6eedffb6c0 1 -- 10.20.193.78:0/965124298 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f6ef00a6230 con 0x7f6ee80079f0 2026-02-13T02:39:39.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.046+0000 7f6ef4fc56c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ec803f990 0x7f6ec805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.049 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.048+0000 7f6eedffb6c0 1 -- 10.20.193.78:0/965124298 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6ef0056700 con 0x7f6ee80079f0 2026-02-13T02:39:39.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.048+0000 7f6ef4fc56c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ec803f990 0x7f6ec805fe40 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6edc004750 tx=0x7f6edc009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:39.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.053+0000 7f6876f466c0 1 -- 10.20.193.78:0/2330887854 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f68701347c0 msgr2=0x7f6870154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.053+0000 7f6876f466c0 1 --2- 10.20.193.78:0/2330887854 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f68701347c0 0x7f6870154c00 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=17170921517068446787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68640098a0 tx=0x7f686402ec70 comp rx=0 tx=0).stop 2026-02-13T02:39:39.067 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.065+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fb5e811db80 con 0x7fb5e80b59a0 2026-02-13T02:39:39.068 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.067+0000 7f6876f466c0 1 -- 10.20.193.78:0/2330887854 shutdown_connections 2026-02-13T02:39:39.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.067+0000 7f6876f466c0 1 --2- 10.20.193.78:0/2330887854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870155340 0x7f68701757f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.067+0000 7f6876f466c0 1 --2- 10.20.193.78:0/2330887854 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f68701347c0 0x7f6870154c00 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=17170921517068446787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.069 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.067+0000 7f6876f466c0 1 --2- 10.20.193.78:0/2330887854 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6870113dc0 0x7f68701341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.067+0000 7f6876f466c0 1 -- 10.20.193.78:0/2330887854 >> 10.20.193.78:0/2330887854 conn(0x7f687005b720 msgr2=0x7f687005bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.068+0000 7f6876f466c0 1 -- 10.20.193.78:0/2330887854 shutdown_connections 2026-02-13T02:39:39.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.068+0000 7f6876f466c0 1 -- 10.20.193.78:0/2330887854 wait complete. 2026-02-13T02:39:39.070 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.069+0000 7f6876f466c0 1 Processor -- start 2026-02-13T02:39:39.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.069+0000 7f6876f466c0 1 -- start start 2026-02-13T02:39:39.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.070+0000 7f6876f466c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870113dc0 0x7f6870154ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.070+0000 7f6876f466c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f68701347c0 0x7f687016d080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.070+0000 7f6876f466c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6870155340 0x7f687016d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.070+0000 7f6876f466c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f687016e380 con 0x7f68701347c0 2026-02-13T02:39:39.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.070+0000 7f6876f466c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f687016e4f0 con 0x7f6870155340 2026-02-13T02:39:39.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.070+0000 7f6876f466c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f687016e6b0 con 0x7f6870113dc0 2026-02-13T02:39:39.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870113dc0 0x7f6870154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870113dc0 0x7f6870154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50230/0 (socket says 10.20.193.78:50230) 2026-02-13T02:39:39.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 -- 10.20.193.78:0/3029989752 learned_addr learned my addr 10.20.193.78:0/3029989752 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:39.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f68767456c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6870155340 0x7f687016d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 -- 10.20.193.78:0/3029989752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6870155340 msgr2=0x7f687016d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6870155340 0x7f687016d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 -- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f68701347c0 msgr2=0x7f687016d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f68701347c0 0x7f687016d080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.071+0000 7f6875f446c0 1 -- 10.20.193.78:0/3029989752 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6860009e40 con 0x7f6870113dc0 2026-02-13T02:39:39.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.073+0000 7f6875f446c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870113dc0 0x7f6870154ba0 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6860005d10 tx=0x7f68600098c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:39.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.073+0000 7f685effd6c0 1 -- 10.20.193.78:0/3029989752 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6860004250 con 0x7f6870113dc0 2026-02-13T02:39:39.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.073+0000 7f685effd6c0 1 -- 10.20.193.78:0/3029989752 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f686000ccc0 con 0x7f6870113dc0 2026-02-13T02:39:39.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.073+0000 7f685effd6c0 1 -- 10.20.193.78:0/3029989752 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68600071c0 con 0x7f6870113dc0 2026-02-13T02:39:39.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.073+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68640094c0 con 0x7f6870113dc0 2026-02-13T02:39:39.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.073+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f687016ed10 con 0x7f6870113dc0 2026-02-13T02:39:39.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.076+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6838005310 con 0x7f6870113dc0 2026-02-13T02:39:39.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.078+0000 7f685effd6c0 1 -- 10.20.193.78:0/3029989752 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f686000c7e0 con 0x7f6870113dc0 2026-02-13T02:39:39.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.079+0000 7f685effd6c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f684803f990 0x7f684805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.081+0000 7f685effd6c0 1 -- 10.20.193.78:0/3029989752 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f6860051660 con 0x7f6870113dc0 2026-02-13T02:39:39.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.082+0000 7f685effd6c0 1 -- 10.20.193.78:0/3029989752 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6860053b80 con 0x7f6870113dc0 2026-02-13T02:39:39.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.082+0000 7f68757436c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f684803f990 0x7f684805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.083+0000 7fb5e5ffb6c0 1 -- 10.20.193.78:0/2216327248 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v33)=0 v33) ==== 125+0+0 (secure 0 0 0) 0x7fb5d8035040 con 0x7fb5e80b59a0 2026-02-13T02:39:39.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.087+0000 7f68757436c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f684803f990 0x7f684805fe40 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f686402f180 tx=0x7f686402f990 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:39.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.087+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5c003f9a0 msgr2=0x7fb5c005fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.087+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5c003f9a0 0x7fb5c005fe50 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e0005980 tx=0x7fb5e0009290 comp rx=0 tx=0).stop 2026-02-13T02:39:39.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.087+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 msgr2=0x7fb5e80f6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.087+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80f6cf0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d80097f0 tx=0x7fb5d8005d70 comp rx=0 tx=0).stop 2026-02-13T02:39:39.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 shutdown_connections 2026-02-13T02:39:39.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5c003f9a0 0x7fb5c005fe50 unknown :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb5e80b6350 0x7fb5e80f7440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e80b59a0 0x7fb5e80f6cf0 unknown :-1 s=CLOSED pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 --2- 10.20.193.78:0/2216327248 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e80b4820 0x7fb5e8125080 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 >> 10.20.193.78:0/2216327248 conn(0x7fb5e8091f60 msgr2=0x7fb5e80b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 shutdown_connections 2026-02-13T02:39:39.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.088+0000 7fb5f5d186c0 1 -- 10.20.193.78:0/2216327248 wait complete. 2026-02-13T02:39:39.096 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.096 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.096 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.096 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.096 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3023135184' entity='client.admin' 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.098 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.098 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.098 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.130+0000 7fee4cc886c0 1 -- 10.20.193.78:0/2682911155 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee48134920 msgr2=0x7fee48154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.130+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/2682911155 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee48134920 0x7fee48154da0 secure :-1 s=READY pgs=31 gs=2 cs=0 l=1 c_cookie=17162694943200105156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee3c0098a0 tx=0x7fee3c02ec90 comp rx=0 tx=0).stop 2026-02-13T02:39:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.130+0000 7fee4cc886c0 1 -- 10.20.193.78:0/2682911155 shutdown_connections 2026-02-13T02:39:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.130+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/2682911155 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fee481554e0 0x7fee48175990 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.130+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/2682911155 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee48134920 0x7fee48154da0 unknown :-1 s=CLOSED pgs=31 gs=2 cs=0 l=1 c_cookie=17162694943200105156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.130+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/2682911155 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee48113f70 0x7fee48134350 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.130+0000 7fee4cc886c0 1 -- 10.20.193.78:0/2682911155 >> 10.20.193.78:0/2682911155 conn(0x7fee4805b8e0 msgr2=0x7fee4805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.131+0000 7fee4cc886c0 1 -- 10.20.193.78:0/2682911155 shutdown_connections 2026-02-13T02:39:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.131+0000 7fee4cc886c0 1 -- 10.20.193.78:0/2682911155 wait complete. 2026-02-13T02:39:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.131+0000 7fee4cc886c0 1 Processor -- start 2026-02-13T02:39:39.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.132+0000 7fee4cc886c0 1 -- start start 2026-02-13T02:39:39.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee4cc886c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee48113f70 0x7fee48154d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee4cc886c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fee48134920 0x7fee4812dd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee4cc886c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee481554e0 0x7fee4812e430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee4cc886c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fee4812f020 con 0x7fee48134920 2026-02-13T02:39:39.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee4cc886c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fee4812f190 con 0x7fee48113f70 2026-02-13T02:39:39.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee4cc886c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee4812f350 con 0x7fee481554e0 2026-02-13T02:39:39.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee46d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee481554e0 0x7fee4812e430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee46d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee481554e0 0x7fee4812e430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50244/0 (socket says 10.20.193.78:50244) 2026-02-13T02:39:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee46d766c0 1 -- 10.20.193.78:0/248999059 learned_addr learned my addr 10.20.193.78:0/248999059 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.133+0000 7fee46d766c0 1 -- 10.20.193.78:0/248999059 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee48113f70 msgr2=0x7fee48154d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:39:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee465756c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee48113f70 0x7fee48154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee46d766c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee48113f70 0x7fee48154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee45d746c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fee48134920 0x7fee4812dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee46d766c0 1 -- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fee48134920 msgr2=0x7fee4812dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee46d766c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fee48134920 0x7fee4812dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee46d766c0 1 -- 10.20.193.78:0/248999059 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c0094c0 con 0x7fee481554e0 2026-02-13T02:39:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee46d766c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee481554e0 0x7fee4812e430 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee38005830 tx=0x7fee3800cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:39.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee377fe6c0 1 -- 10.20.193.78:0/248999059 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee38003c40 con 0x7fee481554e0 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4812f630 con 0x7fee481554e0 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.134+0000 7fee465756c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee48113f70 0x7fee48154d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.135+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4812fb60 con 0x7fee481554e0 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.135+0000 7fee377fe6c0 1 -- 10.20.193.78:0/248999059 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fee3800a030 con 0x7fee481554e0 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.135+0000 7fee377fe6c0 1 -- 10.20.193.78:0/248999059 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee38003c40 con 0x7fee481554e0 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.135+0000 7fee45d746c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fee48134920 0x7fee4812dd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.135+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c005310 con 0x7fee481554e0 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.136+0000 7fee377fe6c0 1 -- 10.20.193.78:0/248999059 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fee3800db90 con 0x7fee481554e0 2026-02-13T02:39:39.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.137+0000 7fee377fe6c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fee2003f8c0 0x7fee2005fd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.137+0000 7fee377fe6c0 1 -- 10.20.193.78:0/248999059 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fee38051f50 con 0x7fee481554e0 2026-02-13T02:39:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.137+0000 7fee465756c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fee2003f8c0 0x7fee2005fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:39.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.138+0000 7fee465756c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fee2003f8c0 0x7fee2005fd70 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee30004770 tx=0x7fee30006e20 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:39.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.139+0000 7fee377fe6c0 1 -- 10.20.193.78:0/248999059 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fee380108c0 con 0x7fee481554e0 2026-02-13T02:39:39.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.155+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f8e1c005b40 con 0x7f8e58155340 2026-02-13T02:39:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.159+0000 7f8e557fa6c0 1 -- 10.20.193.78:0/2951538663 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v34)=0 v34) ==== 115+0+0 (secure 0 0 0) 0x7f8e4400f8b0 con 0x7f8e58155340 2026-02-13T02:39:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.162+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8e2c03f990 msgr2=0x7f8e2c05fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.162+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8e2c03f990 0x7f8e2c05fe40 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e480023e0 tx=0x7f8e48005c80 comp rx=0 tx=0).stop 2026-02-13T02:39:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.162+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58155340 msgr2=0x7f8e580ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.162+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58155340 0x7f8e580ffa50 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e4400b9a0 tx=0x7f8e4400be70 comp rx=0 tx=0).stop 2026-02-13T02:39:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.163+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 shutdown_connections 2026-02-13T02:39:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.163+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8e2c03f990 0x7f8e2c05fe40 unknown :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.163+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8e58155340 0x7f8e580ffa50 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.163+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8e581347c0 0x7f8e581757f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.163+0000 7f8e5d3446c0 1 --2- 10.20.193.78:0/2951538663 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8e58113dc0 0x7f8e58154c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.163+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 >> 10.20.193.78:0/2951538663 conn(0x7f8e5805b720 msgr2=0x7f8e580f61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.166 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.166 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3023135184' entity='client.admin' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.167 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:39.168 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.168 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.168 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.168 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:39.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.174+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 shutdown_connections 2026-02-13T02:39:39.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.174+0000 7f8e5d3446c0 1 -- 10.20.193.78:0/2951538663 wait complete. 2026-02-13T02:39:39.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.195+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f6eb4005b40 con 0x7f6ee80079f0 2026-02-13T02:39:39.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.198+0000 7f6eedffb6c0 1 -- 10.20.193.78:0/965124298 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f6ef005b030 con 0x7f6ee80079f0 2026-02-13T02:39:39.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.200+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ec803f990 msgr2=0x7f6ec805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.200+0000 7f6ec37fe6c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ec803f990 0x7f6ec805fe40 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6edc004750 tx=0x7f6edc009390 comp rx=0 tx=0).stop 2026-02-13T02:39:39.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.200+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 msgr2=0x7f6ee816ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.200+0000 7f6ec37fe6c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 0x7f6ee816ee10 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ef003b370 tx=0x7f6ef003b180 comp rx=0 tx=0).stop 2026-02-13T02:39:39.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 shutdown_connections 2026-02-13T02:39:39.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ec803f990 0x7f6ec805fe40 unknown :-1 s=CLOSED pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ee80079f0 0x7f6ee816ee10 unknown :-1 s=CLOSED pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ee8007040 0x7f6ee816e220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 --2- 10.20.193.78:0/965124298 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ee8005ec0 0x7f6ee816dbd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 >> 10.20.193.78:0/965124298 conn(0x7f6ee80a10e0 msgr2=0x7f6ee80c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 shutdown_connections 2026-02-13T02:39:39.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.201+0000 7f6ec37fe6c0 1 -- 10.20.193.78:0/965124298 wait complete. 2026-02-13T02:39:39.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.230+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f6838005b40 con 0x7f6870113dc0 2026-02-13T02:39:39.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.237+0000 7f685effd6c0 1 -- 10.20.193.78:0/3029989752 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v35)=0 v35) ==== 108+0+0 (secure 0 0 0) 0x7f6860005020 con 0x7f6870113dc0 2026-02-13T02:39:39.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.239+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f684803f990 msgr2=0x7f684805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.239+0000 7f6876f466c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f684803f990 0x7f684805fe40 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f686402f180 tx=0x7f686402f990 comp rx=0 tx=0).stop 2026-02-13T02:39:39.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.239+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870113dc0 msgr2=0x7f6870154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.239+0000 7f6876f466c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870113dc0 0x7f6870154ba0 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6860005d10 tx=0x7f68600098c0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.240+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 shutdown_connections 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.240+0000 7f6876f466c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f684803f990 0x7f684805fe40 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.240+0000 7f6876f466c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6870155340 0x7f687016d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.240+0000 7f6876f466c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f68701347c0 0x7f687016d080 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.240+0000 7f6876f466c0 1 --2- 10.20.193.78:0/3029989752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6870113dc0 0x7f6870154ba0 unknown :-1 s=CLOSED pgs=30 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.240+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 >> 10.20.193.78:0/3029989752 conn(0x7f687005b720 msgr2=0x7f68700f5250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.240+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 shutdown_connections 2026-02-13T02:39:39.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.241+0000 7f6876f466c0 1 -- 10.20.193.78:0/3029989752 wait complete. 2026-02-13T02:39:39.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.283+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fee0c0055c0 con 0x7fee481554e0 2026-02-13T02:39:39.288 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.286+0000 7fee377fe6c0 1 -- 10.20.193.78:0/248999059 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v36)=0 v36) ==== 138+0+0 (secure 0 0 0) 0x7fee380108c0 con 0x7fee481554e0 2026-02-13T02:39:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fee2003f8c0 msgr2=0x7fee2005fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fee2003f8c0 0x7fee2005fd70 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee30004770 tx=0x7fee30006e20 comp rx=0 tx=0).stop 2026-02-13T02:39:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee481554e0 msgr2=0x7fee4812e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee481554e0 0x7fee4812e430 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee38005830 tx=0x7fee3800cca0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 shutdown_connections 2026-02-13T02:39:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fee2003f8c0 0x7fee2005fd70 unknown :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee481554e0 0x7fee4812e430 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fee48134920 0x7fee4812dd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 --2- 10.20.193.78:0/248999059 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee48113f70 0x7fee48154d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 >> 10.20.193.78:0/248999059 conn(0x7fee4805b8e0 msgr2=0x7fee480f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 shutdown_connections 2026-02-13T02:39:39.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.291+0000 7fee4cc886c0 1 -- 10.20.193.78:0/248999059 wait complete. 2026-02-13T02:39:39.581 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.582 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.582 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.582 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.582 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.585 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.585 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.585 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.585 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.586 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1779b03c-0885-11f1-aeb9-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial078') 2026-02-13T02:39:39.586 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config dump 2026-02-13T02:39:39.806 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:40.001 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/1841440106 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b810fbf0 msgr2=0x7ff8b8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/1841440106 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b810fbf0 0x7ff8b8114c30 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=4835371357856005789 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ac0098d0 tx=0x7ff8ac02ec30 comp rx=0 tx=0).stop 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/1841440106 shutdown_connections 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/1841440106 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8b8115410 0x7ff8b8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/1841440106 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b810fbf0 0x7ff8b8114c30 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=4835371357856005789 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/1841440106 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8b810f200 0x7ff8b810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/1841440106 >> 10.20.193.78:0/1841440106 conn(0x7ff8b80ecb00 msgr2=0x7ff8b810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/1841440106 shutdown_connections 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.998+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/1841440106 wait complete. 2026-02-13T02:39:40.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 Processor -- start 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 -- start start 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8b810f200 0x7ff8b80f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b8115410 0x7ff8b8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8b80f5140 0x7ff8b80fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b80f5830 con 0x7ff8b8115410 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b80fa950 con 0x7ff8b80f5140 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bffeb6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b80fab10 con 0x7ff8b810f200 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bdd5c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8b810f200 0x7ff8b80f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b8115410 0x7ff8b8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b8115410 0x7ff8b8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47736/0 (socket says 10.20.193.78:47736) 2026-02-13T02:39:40.003 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 -- 10.20.193.78:0/2856518702 learned_addr learned my addr 10.20.193.78:0/2856518702 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8be55d6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8b80f5140 0x7ff8b80fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 -- 10.20.193.78:0/2856518702 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8b810f200 msgr2=0x7ff8b80f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8b810f200 0x7ff8b80f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 -- 10.20.193.78:0/2856518702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8b80f5140 msgr2=0x7ff8b80fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8b80f5140 0x7ff8b80fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:39.999+0000 7ff8bd55b6c0 1 -- 10.20.193.78:0/2856518702 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a8009590 con 0x7ff8b8115410 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.000+0000 7ff8bd55b6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b8115410 0x7ff8b8175cb0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ac005a00 tx=0x7ff8ac02fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.000+0000 7ff8a6ffd6c0 1 -- 10.20.193.78:0/2856518702 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8ac002ae0 con 0x7ff8b8115410 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.000+0000 7ff8a6ffd6c0 1 -- 10.20.193.78:0/2856518702 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff8ac002c40 con 0x7ff8b8115410 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.000+0000 7ff8a6ffd6c0 1 -- 10.20.193.78:0/2856518702 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8ac0362f0 con 0x7ff8b8115410 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.000+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac0094c0 con 0x7ff8b8115410 2026-02-13T02:39:40.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.000+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b80fb030 con 0x7ff8b8115410 2026-02-13T02:39:40.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.000+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b81104d0 con 0x7ff8b8115410 2026-02-13T02:39:40.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.001+0000 7ff8a6ffd6c0 1 -- 10.20.193.78:0/2856518702 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7ff8ac0071c0 con 0x7ff8b8115410 2026-02-13T02:39:40.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.001+0000 7ff8a6ffd6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff89403f940 0x7ff89405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:40.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.001+0000 7ff8a6ffd6c0 1 -- 10.20.193.78:0/2856518702 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ff8ac075270 con 0x7ff8b8115410 2026-02-13T02:39:40.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.001+0000 7ff8bdd5c6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff89403f940 0x7ff89405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:40.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.002+0000 7ff8bdd5c6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff89403f940 0x7ff89405fdf0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8a8005b40 tx=0x7ff8a8009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:40.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.003+0000 7ff8a6ffd6c0 1 -- 10.20.193.78:0/2856518702 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8ac007e40 con 0x7ff8b8115410 2026-02-13T02:39:40.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.103+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff8b80fb250 con 0x7ff8b8115410 2026-02-13T02:39:40.105 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3830377176' entity='client.admin' 2026-02-13T02:39:40.105 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.105 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.105 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2184544306' entity='client.admin' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:39:40.106 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:40.107 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:40.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.103+0000 7ff8a6ffd6c0 1 -- 10.20.193.78:0/2856518702 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v36) ==== 59+0+19758 (secure 0 0 0) 0x7ff8ac0348d0 con 0x7ff8b8115410 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global dev auth_debug true 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global basic log_to_file true 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global basic log_to_journald false 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global basic log_to_stderr false 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_allow_pool_delete true 2026-02-13T02:39:40.108 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global dev ms_die_on_bug true 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global dev ms_die_on_old_message true 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global dev ms_die_on_skipped_message false 2026-02-13T02:39:40.109 INFO:teuthology.orchestra.run.trial078.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced debug_mon 20/20 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced debug_ms 1/1 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced debug_paxos 20/20 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T02:39:40.110 INFO:teuthology.orchestra.run.trial078.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced client_mount_timeout 30 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced debug_cephsqlite 20/20 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced debug_client 20/20 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced debug_mgr 20/20 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced debug_ms 1/1 2026-02-13T02:39:40.111 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mgr/snap_schedule/log_level debug 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:osd dev bdev_debug_aio true 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T02:39:40.112 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced debug_bluefs 20/20 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced debug_bluestore 20/20 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced debug_ms 1/1 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced debug_osd 20/20 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced debug_rocksdb 10/10 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_debug_op_order true 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_debug_shutdown true 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T02:39:40.113 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_max_omap_entries_per_request 10 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T02:39:40.114 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced debug_mds 20/20 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced debug_ms 2/2 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T02:39:40.115 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced mds_bal_split_size 100 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds dev mds_debug_frag true 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds dev mds_debug_scatterstat true 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds dev mds_verify_scatter true 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T02:39:40.116 INFO:teuthology.orchestra.run.trial078.stdout:client advanced client_mount_timeout 600 2026-02-13T02:39:40.117 INFO:teuthology.orchestra.run.trial078.stdout:client advanced debug_client 20/20 2026-02-13T02:39:40.117 INFO:teuthology.orchestra.run.trial078.stdout:client advanced debug_ms 1/1 2026-02-13T02:39:40.117 INFO:teuthology.orchestra.run.trial078.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T02:39:40.117 INFO:teuthology.orchestra.run.trial078.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T02:39:40.117 INFO:teuthology.orchestra.run.trial078.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T02:39:40.117 INFO:teuthology.orchestra.run.trial078.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T02:39:40.117 INFO:teuthology.orchestra.run.trial078.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T02:39:40.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff89403f940 msgr2=0x7ff89405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:40.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff89403f940 0x7ff89405fdf0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8a8005b40 tx=0x7ff8a8009310 comp rx=0 tx=0).stop 2026-02-13T02:39:40.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b8115410 msgr2=0x7ff8b8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:40.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b8115410 0x7ff8b8175cb0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8ac005a00 tx=0x7ff8ac02fb90 comp rx=0 tx=0).stop 2026-02-13T02:39:40.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 shutdown_connections 2026-02-13T02:39:40.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff89403f940 0x7ff89405fdf0 unknown :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8b80f5140 0x7ff8b80fa410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff8b8115410 0x7ff8b8175cb0 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 --2- 10.20.193.78:0/2856518702 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8b810f200 0x7ff8b80f4b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:40.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 >> 10.20.193.78:0/2856518702 conn(0x7ff8b80ecb00 msgr2=0x7ff8b8113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:40.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 shutdown_connections 2026-02-13T02:39:40.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:40.105+0000 7ff8bffeb6c0 1 -- 10.20.193.78:0/2856518702 wait complete. 2026-02-13T02:39:40.128 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3830377176' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2184544306' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.129 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.130 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.130 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:40.130 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:39:40.130 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:40.130 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:40.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3830377176' entity='client.admin' 2026-02-13T02:39:40.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2184544306' entity='client.admin' 2026-02-13T02:39:40.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:40.210 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T02:39:40.211 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:39:40.211 DEBUG:teuthology.orchestra.run.trial078:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:39:40.252 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:39:40.252 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_1 2026-02-13T02:39:40.332 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:39:40.332 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:40.332 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1100 Links: 1 2026-02-13T02:39:40.333 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:40.333 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:40.333 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:39:11.455622092 +0000 2026-02-13T02:39:40.333 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:37:23.767657711 +0000 2026-02-13T02:39:40.333 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:37:23.767657711 +0000 2026-02-13T02:39:40.333 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:37:23.767657711 +0000 2026-02-13T02:39:40.334 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:39:40.426 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:39:40.427 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:39:40.427 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000225132 s, 2.3 MB/s 2026-02-13T02:39:40.429 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:39:40.470 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_2 2026-02-13T02:39:40.471 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 systemd[1]: Started Ceph mgr.z for 1779b03c-0885-11f1-aeb9-d404e6e7d460. 2026-02-13T02:39:40.548 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1079 Links: 1 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:39:11.455622092 +0000 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:37:23.760657831 +0000 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:37:23.760657831 +0000 2026-02-13T02:39:40.549 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:37:23.760657831 +0000 2026-02-13T02:39:40.550 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:39:40.642 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:39:40.642 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:39:40.642 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000229108 s, 2.2 MB/s 2026-02-13T02:39:40.644 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:39:40.685 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_3 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1083 Links: 1 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:39:11.455622092 +0000 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:37:23.762045729 +0000 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:37:23.762045729 +0000 2026-02-13T02:39:40.764 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:37:23.762045729 +0000 2026-02-13T02:39:40.765 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:39:40.766 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mgr[30103]: -- 10.20.193.154:0/4250744273 <== mon.1 v2:10.20.193.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea24565a00 con 0x55ea24639400 2026-02-13T02:39:40.766 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.477+0000 7fc571fe7fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:39:40.766 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.519+0000 7fc571fe7fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:39:40.857 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:39:40.857 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:39:40.857 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000292127 s, 1.8 MB/s 2026-02-13T02:39:40.860 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:39:40.900 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_4 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout:Device: 6h/6d Inode: 1088 Links: 1 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:39:11.455622092 +0000 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:37:23.764657763 +0000 2026-02-13T02:39:40.979 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:37:23.764657763 +0000 2026-02-13T02:39:40.980 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:37:23.764657763 +0000 2026-02-13T02:39:40.980 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:39:41.072 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:39:41.072 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:39:41.072 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000217537 s, 2.4 MB/s 2026-02-13T02:39:41.074 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:39:41.075 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2856518702' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.773+0000 7fc571fe7fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:39:41.076 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.782+0000 7fc571fe7fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.788+0000 7fc571fe7fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.795+0000 7fc571fe7fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.801+0000 7fc571fe7fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.813+0000 7fc571fe7fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.838+0000 7fc571fe7fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.841+0000 7fc571fe7fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.842+0000 7fc571fe7fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.849+0000 7fc571fe7fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.886+0000 7fc571fe7fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.888+0000 7fc571fe7fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.891+0000 7fc571fe7fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:39:41.077 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.894+0000 7fc571fe7fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:39:41.078 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.894+0000 7fc571fe7fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:39:41.078 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.897+0000 7fc571fe7fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:39:41.078 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.898+0000 7fc571fe7fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:39:41.078 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.901+0000 7fc571fe7fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:39:41.078 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:40.903+0000 7fc571fe7fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:39:41.078 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.071+0000 7fc571fe7fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:39:41.078 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.071+0000 7fc571fe7fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:39:41.118 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T02:39:41.118 DEBUG:teuthology.orchestra.run.trial091:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:39:41.136 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:39:41.136 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_1 2026-02-13T02:39:41.152 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2856518702' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T02:39:41.152 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.152 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.152 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.152 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:41.152 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:39:41.152 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:41.153 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:41.169 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:39:41.169 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:41.169 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-13T02:39:41.169 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:41.169 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:41.169 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 02:39:41.105750065 +0000 2026-02-13T02:39:41.170 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.170 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.170 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.170 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:39:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2856518702' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T02:39:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:39:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:41.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:41.234 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T02:39:41.234 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T02:39:41.234 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000167761 s, 3.1 MB/s 2026-02-13T02:39:41.236 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:39:41.294 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_2 2026-02-13T02:39:41.349 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 02:39:41.106750040 +0000 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.350 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.351 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:39:41.410 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.336+0000 7faa8a73efc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:39:41.412 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T02:39:41.413 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T02:39:41.413 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000163904 s, 3.1 MB/s 2026-02-13T02:39:41.414 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:39:41.470 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_3 2026-02-13T02:39:41.515 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.074+0000 7fc571fe7fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:39:41.515 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.076+0000 7fc571fe7fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.077+0000 7fc571fe7fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.078+0000 7fc571fe7fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.078+0000 7fc571fe7fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.223+0000 7fc571fe7fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.252+0000 7fc571fe7fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.256+0000 7fc571fe7fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.257+0000 7fc571fe7fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:39:41.516 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 02:39:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-z[30096]: 2026-02-13T02:39:41.257+0000 7fc571fe7fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 02:39:41.106750040 +0000 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.526 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.527 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:39:41.588 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T02:39:41.589 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T02:39:41.589 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000163132 s, 3.1 MB/s 2026-02-13T02:39:41.590 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:39:41.645 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_4 2026-02-13T02:39:41.661 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.594+0000 7faa8a73efc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:39:41.661 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.604+0000 7faa8a73efc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:39:41.661 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.610+0000 7faa8a73efc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:39:41.662 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.617+0000 7faa8a73efc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:39:41.662 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.623+0000 7faa8a73efc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:39:41.662 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.635+0000 7faa8a73efc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:39:41.662 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.660+0000 7faa8a73efc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:39:41.678 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 02:39:41.106750040 +0000 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.679 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 02:37:23.819025101 +0000 2026-02-13T02:39:41.680 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:39:41.743 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T02:39:41.743 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T02:39:41.744 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000166458 s, 3.1 MB/s 2026-02-13T02:39:41.745 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:39:41.801 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T02:39:41.801 DEBUG:teuthology.orchestra.run.trial154:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:39:41.819 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:39:41.819 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_1 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 02:39:40.282377804 +0000 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:41.876 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:41.877 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:41.877 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:39:41.914 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:41 trial091 ceph-mon[27614]: Standby manager daemon z started 2026-02-13T02:39:41.914 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.914 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.914 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.914 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:41.914 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.663+0000 7faa8a73efc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.665+0000 7faa8a73efc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.672+0000 7faa8a73efc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.711+0000 7faa8a73efc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.713+0000 7faa8a73efc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.717+0000 7faa8a73efc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.719+0000 7faa8a73efc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.720+0000 7faa8a73efc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.723+0000 7faa8a73efc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:39:41.915 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.724+0000 7faa8a73efc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:39:41.916 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.726+0000 7faa8a73efc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:39:41.916 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.729+0000 7faa8a73efc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:39:41.916 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.913+0000 7faa8a73efc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:39:41.916 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.913+0000 7faa8a73efc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:39:41.941 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T02:39:41.941 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T02:39:41.941 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000157584 s, 3.2 MB/s 2026-02-13T02:39:41.943 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:39:42.001 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_2 2026-02-13T02:39:42.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:41 trial154 ceph-mon[27921]: Standby manager daemon z started 2026-02-13T02:39:42.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:42.031 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 02:39:40.283377796 +0000 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:42.032 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:42.033 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:39:42.094 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T02:39:42.094 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T02:39:42.094 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.00014955 s, 3.4 MB/s 2026-02-13T02:39:42.095 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:39:42.153 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_3 2026-02-13T02:39:42.195 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.915+0000 7faa8a73efc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:39:42.195 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.918+0000 7faa8a73efc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:39:42.195 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.919+0000 7faa8a73efc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:39:42.195 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.920+0000 7faa8a73efc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:39:42.196 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:41.920+0000 7faa8a73efc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:39:42.196 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:42 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:42.063+0000 7faa8a73efc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:39:42.196 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:42 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:42.092+0000 7faa8a73efc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:39:42.196 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:42 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:42.096+0000 7faa8a73efc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:39:42.196 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:42 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:42.097+0000 7faa8a73efc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:39:42.196 INFO:journalctl@ceph.mgr.y.trial091.stdout:Feb 13 02:39:42 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-y[29749]: 2026-02-13T02:39:42.097+0000 7faa8a73efc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:39:42.208 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 02:39:40.283377796 +0000 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 02:37:22.858442835 +0000 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 02:37:22.858442835 +0000 2026-02-13T02:39:42.209 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 02:37:22.858442835 +0000 2026-02-13T02:39:42.209 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:39:42.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:41 trial078 ceph-mon[22944]: Standby manager daemon z started 2026-02-13T02:39:42.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:42.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:42.271 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T02:39:42.271 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T02:39:42.271 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000174166 s, 2.9 MB/s 2026-02-13T02:39:42.273 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:39:42.330 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_4 2026-02-13T02:39:42.386 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 02:39:40.283377796 +0000 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:42.387 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 02:37:22.857442839 +0000 2026-02-13T02:39:42.388 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:39:42.449 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T02:39:42.449 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T02:39:42.449 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000148037 s, 3.5 MB/s 2026-02-13T02:39:42.450 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:39:42.508 INFO:tasks.cephadm:Deploying osd.0 on trial078 with /dev/vg_nvme/lv_4... 2026-02-13T02:39:42.508 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T02:39:42.713 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:43.027 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: mgrmap e13: x(active, since 7s), standbys: z 2026-02-13T02:39:43.027 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T02:39:43.027 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.027 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.027 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.027 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: Standby manager daemon y started 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:43.028 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: mgrmap e13: x(active, since 7s), standbys: z 2026-02-13T02:39:43.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T02:39:43.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: Standby manager daemon y started 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:43.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:43.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: mgrmap e13: x(active, since 7s), standbys: z 2026-02-13T02:39:43.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T02:39:43.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: Standby manager daemon y started 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:43.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:43.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:43.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:43.584 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:39:43.608 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_4 --skip-validation 2026-02-13T02:39:43.793 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:39:43.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c1ffb6c0 1 -- 10.20.193.78:0/955327887 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7ac02fde0 con 0x7ff7c41146d0 2026-02-13T02:39:43.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 -- 10.20.193.78:0/955327887 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 msgr2=0x7ff7c415bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:43.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/955327887 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 0x7ff7c415bab0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=14792448920460835747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7ac009970 tx=0x7ff7ac02ed20 comp rx=0 tx=0).stop 2026-02-13T02:39:43.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 -- 10.20.193.78:0/955327887 shutdown_connections 2026-02-13T02:39:43.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/955327887 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff7c415bff0 0x7ff7c417c3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:43.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/955327887 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 0x7ff7c415bab0 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=14792448920460835747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:43.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/955327887 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff7c4113dc0 0x7ff7c4114190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:43.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 -- 10.20.193.78:0/955327887 >> 10.20.193.78:0/955327887 conn(0x7ff7c4058a50 msgr2=0x7ff7c4058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:43.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 -- 10.20.193.78:0/955327887 shutdown_connections 2026-02-13T02:39:43.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.987+0000 7ff7c96986c0 1 -- 10.20.193.78:0/955327887 wait complete. 2026-02-13T02:39:43.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 Processor -- start 2026-02-13T02:39:43.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 -- start start 2026-02-13T02:39:43.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff7c4113dc0 0x7ff7c40ff230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:43.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 0x7ff7c40ff770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:43.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff7c415bff0 0x7ff7c4104b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:43.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c4105180 con 0x7ff7c415bff0 2026-02-13T02:39:43.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c41052f0 con 0x7ff7c41146d0 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.988+0000 7ff7c96986c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c41054b0 con 0x7ff7c4113dc0 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c2ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff7c4113dc0 0x7ff7c40ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c27fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 0x7ff7c40ff770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c2ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff7c4113dc0 0x7ff7c40ff230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:50280/0 (socket says 10.20.193.78:50280) 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c2ffd6c0 1 -- 10.20.193.78:0/221040434 learned_addr learned my addr 10.20.193.78:0/221040434 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c27fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 0x7ff7c40ff770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37894/0 (socket says 10.20.193.78:37894) 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c37fe6c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff7c415bff0 0x7ff7c4104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c37fe6c0 1 -- 10.20.193.78:0/221040434 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff7c4113dc0 msgr2=0x7ff7c40ff230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c37fe6c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff7c4113dc0 0x7ff7c40ff230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c37fe6c0 1 -- 10.20.193.78:0/221040434 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 msgr2=0x7ff7c40ff770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:43.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c37fe6c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 0x7ff7c40ff770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c37fe6c0 1 -- 10.20.193.78:0/221040434 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac009590 con 0x7ff7c415bff0 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c37fe6c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff7c415bff0 0x7ff7c4104b30 secure :-1 s=READY pgs=112 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7b4005830 tx=0x7ff7b400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7b4003c40 con 0x7ff7c415bff0 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c4105790 con 0x7ff7c415bff0 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff7b400a070 con 0x7ff7c415bff0 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c4157af0 con 0x7ff7c415bff0 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.989+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7b400dd20 con 0x7ff7c415bff0 2026-02-13T02:39:43.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.990+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c405b000 con 0x7ff7c415bff0 2026-02-13T02:39:43.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.992+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7ff7b4005030 con 0x7ff7c415bff0 2026-02-13T02:39:43.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.994+0000 7ff7a3fff6c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7980b5640 0x7ff7980d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:43.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.994+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ff7b40e2cb0 con 0x7ff7c415bff0 2026-02-13T02:39:43.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.994+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff7b40e30e0 con 0x7ff7c415bff0 2026-02-13T02:39:43.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.994+0000 7ff7c2ffd6c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7980b5640 0x7ff7980d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:43.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:43.994+0000 7ff7c2ffd6c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7980b5640 0x7ff7980d5af0 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7b80095e0 tx=0x7ff7b8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:44.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:44.100+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ff7c4100380 con 0x7ff7980b5640 2026-02-13T02:39:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: mgrmap e14: x(active, since 8s), standbys: y, z 2026-02-13T02:39:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T02:39:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:44.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:44.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:44.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:44.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: mgrmap e14: x(active, since 8s), standbys: y, z 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:44.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:44.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:44.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: mgrmap e14: x(active, since 8s), standbys: y, z 2026-02-13T02:39:44.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T02:39:44.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:44.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:45.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:45.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:45.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:45.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:45.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:45.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:45.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='client.14340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:45.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:45.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:45.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:45.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:45.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:46.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:46 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3573990228' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e4e99f87-c52f-4ab4-9ef0-2fc796b8084f"} : dispatch 2026-02-13T02:39:46.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:46 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3573990228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4e99f87-c52f-4ab4-9ef0-2fc796b8084f"}]': finished 2026-02-13T02:39:46.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:46 trial091 ceph-mon[27614]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T02:39:46.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:46.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:46 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1780202374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:39:46.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:46 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3573990228' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e4e99f87-c52f-4ab4-9ef0-2fc796b8084f"} : dispatch 2026-02-13T02:39:46.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:46 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3573990228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4e99f87-c52f-4ab4-9ef0-2fc796b8084f"}]': finished 2026-02-13T02:39:46.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:46 trial078 ceph-mon[22944]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T02:39:46.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:46.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:46 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1780202374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:39:46.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:46 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3573990228' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e4e99f87-c52f-4ab4-9ef0-2fc796b8084f"} : dispatch 2026-02-13T02:39:46.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:46 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3573990228' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4e99f87-c52f-4ab4-9ef0-2fc796b8084f"}]': finished 2026-02-13T02:39:46.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:46 trial154 ceph-mon[27921]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T02:39:46.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:46.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:46 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1780202374' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:39:48.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T02:39:48.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:49.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T02:39:49.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:49.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T02:39:49.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:52.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:52 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:52.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:52 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:52.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:52 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:52 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:52 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:52 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:53.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:52 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:53.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:52 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:53.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:52 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:53.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:53.991+0000 7ff7c8e976c0 1 -- 10.20.193.78:0/221040434 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=5}) -- 0x7ff79c003570 con 0x7ff7c415bff0 2026-02-13T02:39:53.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:53.991+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mon.0 v2:10.20.193.78:3300/0 7 ==== osd_map(5..5 src has 1..5) ==== 324+0+0 (secure 0 0 0) 0x7ff7b40ab6a0 con 0x7ff7c415bff0 2026-02-13T02:39:54.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.022+0000 7ff7a3fff6c0 1 -- 10.20.193.78:0/221040434 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ff7c4100380 con 0x7ff7980b5640 2026-02-13T02:39:54.032 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 0 on host 'trial078' 2026-02-13T02:39:54.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7980b5640 msgr2=0x7ff7980d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:54.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7980b5640 0x7ff7980d5af0 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7b80095e0 tx=0x7ff7b8009260 comp rx=0 tx=0).stop 2026-02-13T02:39:54.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff7c415bff0 msgr2=0x7ff7c4104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:54.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff7c415bff0 0x7ff7c4104b30 secure :-1 s=READY pgs=112 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7b4005830 tx=0x7ff7b400cc00 comp rx=0 tx=0).stop 2026-02-13T02:39:54.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 shutdown_connections 2026-02-13T02:39:54.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7980b5640 0x7ff7980d5af0 unknown :-1 s=CLOSED pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff7c415bff0 0x7ff7c4104b30 unknown :-1 s=CLOSED pgs=112 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff7c41146d0 0x7ff7c40ff770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 --2- 10.20.193.78:0/221040434 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff7c4113dc0 0x7ff7c40ff230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 >> 10.20.193.78:0/221040434 conn(0x7ff7c4058a50 msgr2=0x7ff7c40f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:54.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 shutdown_connections 2026-02-13T02:39:54.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:39:54.033+0000 7ff7c96986c0 1 -- 10.20.193.78:0/221040434 wait complete. 2026-02-13T02:39:54.136 DEBUG:teuthology.orchestra.run.trial078:osd.0> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.0.service 2026-02-13T02:39:54.140 INFO:tasks.cephadm:Deploying osd.1 on trial091 with /dev/vg_nvme/lv_4... 2026-02-13T02:39:54.140 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T02:39:54.258 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:39:54.700 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:39:54.718 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_4 --skip-validation 2026-02-13T02:39:54.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:54.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:54.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:54.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:54.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:54.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:39:54.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:39:54.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.741 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.741 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.742 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:54.837 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/333300684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a1410f200 msgr2=0x7f5a1410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/333300684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a1410f200 0x7f5a1410f5d0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=3607093683851778709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a00009970 tx=0x7f5a0002ed20 comp rx=0 tx=0).stop 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/333300684 shutdown_connections 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/333300684 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5a14115410 0x7f5a14175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/333300684 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5a1410fbf0 0x7f5a14114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/333300684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a1410f200 0x7f5a1410f5d0 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=3607093683851778709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/333300684 >> 10.20.193.91:0/333300684 conn(0x7f5a140ecb00 msgr2=0x7f5a1410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:39:54.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/333300684 shutdown_connections 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.956+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/333300684 wait complete. 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 Processor -- start 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 -- start start 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5a1410f200 0x7f5a1411d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a14115410 0x7f5a1411d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5a14122a70 0x7f5a14122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5a14123480 con 0x7f5a1410f200 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5a141235f0 con 0x7f5a14115410 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a141237b0 con 0x7f5a14122a70 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a14115410 0x7f5a1411d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:54.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a14115410 0x7f5a1411d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:33392/0 (socket says 10.20.193.91:33392) 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 -- 10.20.193.91:0/4077589925 learned_addr learned my addr 10.20.193.91:0/4077589925 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a189026c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5a14122a70 0x7f5a14122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a13fff6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5a1410f200 0x7f5a1411d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 -- 10.20.193.91:0/4077589925 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5a14122a70 msgr2=0x7f5a14122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5a14122a70 0x7f5a14122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 -- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5a1410f200 msgr2=0x7f5a1411d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5a1410f200 0x7f5a1411d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 -- 10.20.193.91:0/4077589925 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a00009590 con 0x7f5a14115410 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a189026c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5a14122a70 0x7f5a14122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a13fff6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5a1410f200 0x7f5a1411d170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:39:54.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a137fe6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a14115410 0x7f5a1411d6b0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59fc005dc0 tx=0x7f59fc00bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:54.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a117fa6c0 1 -- 10.20.193.91:0/4077589925 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59fc004250 con 0x7f5a14115410 2026-02-13T02:39:54.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a117fa6c0 1 -- 10.20.193.91:0/4077589925 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59fc009070 con 0x7f5a14115410 2026-02-13T02:39:54.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a14163c60 con 0x7f5a14115410 2026-02-13T02:39:54.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a117fa6c0 1 -- 10.20.193.91:0/4077589925 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59fc00cdc0 con 0x7f5a14115410 2026-02-13T02:39:54.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.957+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a14164140 con 0x7f5a14115410 2026-02-13T02:39:54.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.958+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a141104d0 con 0x7f5a14115410 2026-02-13T02:39:54.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.959+0000 7f5a117fa6c0 1 -- 10.20.193.91:0/4077589925 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f59fc0028c0 con 0x7f5a14115410 2026-02-13T02:39:54.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.959+0000 7f5a117fa6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59dc0b5640 0x7f59dc0d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:39:54.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.959+0000 7f5a117fa6c0 1 -- 10.20.193.91:0/4077589925 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1356+0+0 (secure 0 0 0) 0x7f59fc0e1f90 con 0x7f5a14115410 2026-02-13T02:39:54.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.960+0000 7f5a13fff6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59dc0b5640 0x7f59dc0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:39:54.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.960+0000 7f5a13fff6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59dc0b5640 0x7f59dc0d5af0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a0002f230 tx=0x7f5a000023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:39:54.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:54.960+0000 7f5a117fa6c0 1 -- 10.20.193.91:0/4077589925 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f59fc0a6540 con 0x7f5a14115410 2026-02-13T02:39:55.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:39:55.056+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f5a1411e350 con 0x7f59dc0b5640 2026-02-13T02:39:55.674 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:39:55.674 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T02:39:55.674 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T02:39:55.674 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:55.674 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:39:55.675 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:55.675 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:55.675 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:55.675 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:55.675 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:55.675 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:55.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:39:55.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T02:39:55.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:55.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:55.728 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:39:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0[35916]: 2026-02-13T02:39:55.481+0000 7f69df0076c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T02:39:55.729 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:39:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0[35916]: 2026-02-13T02:39:55.485+0000 7f69daecb6c0 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:39:55.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:39:55.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T02:39:55.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T02:39:55.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:55.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:39:55.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:55.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:55.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:55.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:55.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:55.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:56.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"} : dispatch 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/2189853784' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"} : dispatch 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"}]': finished 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] boot 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T02:39:56.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:56.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:56.698 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:56.698 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:56 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/3274016607' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:39:56.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:56.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:39:56.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T02:39:56.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"} : dispatch 2026-02-13T02:39:56.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/2189853784' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"} : dispatch 2026-02-13T02:39:56.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"}]': finished 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] boot 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:56.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:56.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:56.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:56.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:56.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:56 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/3274016607' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:39:56.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:39:56.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:39:56.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"} : dispatch 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/2189853784' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"} : dispatch 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75b41a4c-dddc-4c29-885c-997d3f7212c8"}]': finished 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: osd.0 [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] boot 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:39:56.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:56.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:56 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/3274016607' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:39:57.538 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:57 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:39:57.539 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:57 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:39:57.539 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:57 trial091 ceph-mon[27614]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:57.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:57 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:39:57.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:57 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:39:57.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:57 trial154 ceph-mon[27921]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:57 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:39:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:57 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:39:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:57 trial078 ceph-mon[22944]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:39:58.649 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:58.649 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.649 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T02:39:58.650 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:58.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T02:39:58.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:39:58.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:39:58.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:39:58.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:39:58.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:39:58.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:58.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T02:39:58.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:39:59.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:59 trial154 ceph-mon[27921]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:59 trial154 ceph-mon[27921]: pgmap v9: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:59 trial154 ceph-mon[27921]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:39:59 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:39:59.821 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:59 trial091 ceph-mon[27614]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.821 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:59 trial091 ceph-mon[27614]: pgmap v9: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.821 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:59 trial091 ceph-mon[27614]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.821 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:39:59 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:39:59.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:59 trial078 ceph-mon[22944]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:59 trial078 ceph-mon[22944]: pgmap v9: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:59 trial078 ceph-mon[22944]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:39:59.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:39:59 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:00.533 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial091 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp6mii5fx2:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp4riesbwj:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_4 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T02:40:00.534 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T02:40:00.535 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: Traceback (most recent call last): 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: return _run_code(code, main_globals, None, 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: exec(code, run_globals) 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T02:40:00.536 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial091 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp6mii5fx2:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp4riesbwj:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_4 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:00.537 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:00.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T02:40:00.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T02:40:00.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:40:00.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial091 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp6mii5fx2:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp4riesbwj:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_4 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:40:00.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T02:40:00.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T02:40:00.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T02:40:00.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: Traceback (most recent call last): 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: return _run_code(code, main_globals, None, 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: exec(code, run_globals) 2026-02-13T02:40:00.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial091 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp6mii5fx2:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp4riesbwj:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_4 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:00.769 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:00.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial091 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp6mii5fx2:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp4riesbwj:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_4 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T02:40:00.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T02:40:00.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: Traceback (most recent call last): 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: return _run_code(code, main_globals, None, 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: exec(code, run_globals) 2026-02-13T02:40:00.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: File "/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial091 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp6mii5fx2:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp4riesbwj:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_4 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:00.981 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:00.982 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.116+0000 7f5a117fa6c0 1 -- 10.20.193.91:0/4077589925 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f5a0002f840 con 0x7f59dc0b5640 2026-02-13T02:40:01.116 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 1 on host 'trial091' 2026-02-13T02:40:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59dc0b5640 msgr2=0x7f59dc0d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59dc0b5640 0x7f59dc0d5af0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a0002f230 tx=0x7f5a000023a0 comp rx=0 tx=0).stop 2026-02-13T02:40:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a14115410 msgr2=0x7f5a1411d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a14115410 0x7f5a1411d6b0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59fc005dc0 tx=0x7f59fc00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:40:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 shutdown_connections 2026-02-13T02:40:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59dc0b5640 0x7f59dc0d5af0 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:01.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5a14122a70 0x7f5a14122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:01.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5a14115410 0x7f5a1411d6b0 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:01.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 --2- 10.20.193.91:0/4077589925 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5a1410f200 0x7f5a1411d170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:01.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 >> 10.20.193.91:0/4077589925 conn(0x7f5a140ecb00 msgr2=0x7f5a1410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:01.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 shutdown_connections 2026-02-13T02:40:01.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:01.118+0000 7f5a1a38c6c0 1 -- 10.20.193.91:0/4077589925 wait complete. 2026-02-13T02:40:01.159 DEBUG:teuthology.orchestra.run.trial091:osd.1> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.1.service 2026-02-13T02:40:01.201 INFO:tasks.cephadm:Deploying osd.2 on trial154 with /dev/vg_nvme/lv_4... 2026-02-13T02:40:01.201 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T02:40:01.338 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:40:01.732 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:01.733 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.733 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.733 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:01.733 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:01.733 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.733 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.734 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:01.759 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:40:01.776 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_4 --skip-validation 2026-02-13T02:40:01.894 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:02.007 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- 10.20.193.154:0/3903826206 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c641131c0 msgr2=0x7f4c64173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3903826206 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c641131c0 0x7f4c64173b60 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=14047236400082891233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c5400aa70 tx=0x7f4c5402fde0 comp rx=0 tx=0).stop 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- 10.20.193.154:0/3903826206 shutdown_connections 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3903826206 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c641131c0 0x7f4c64173b60 unknown :-1 s=CLOSED pgs=37 gs=1 cs=0 l=1 c_cookie=14047236400082891233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3903826206 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c6410d9a0 0x7f4c641129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3903826206 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c6410cfb0 0x7f4c6410d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- 10.20.193.154:0/3903826206 >> 10.20.193.154:0/3903826206 conn(0x7f4c640ea8b0 msgr2=0x7f4c6410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- 10.20.193.154:0/3903826206 shutdown_connections 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- 10.20.193.154:0/3903826206 wait complete. 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 Processor -- start 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- start start 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c6410cfb0 0x7f4c640f4aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c641131c0 0x7f4c64173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c640f50d0 0x7f4c640fa3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4c640f57c0 con 0x7f4c641131c0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4c640fa8e0 con 0x7f4c6410cfb0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.004+0000 7f4c694386c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c640faaa0 con 0x7f4c640f50d0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c640f50d0 0x7f4c640fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c640f50d0 0x7f4c640fa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:55804/0 (socket says 10.20.193.154:55804) 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 -- 10.20.193.154:0/3579497722 learned_addr learned my addr 10.20.193.154:0/3579497722 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c62ffd6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c6410cfb0 0x7f4c640f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 -- 10.20.193.154:0/3579497722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c6410cfb0 msgr2=0x7f4c640f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c6410cfb0 0x7f4c640f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c627fc6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c641131c0 0x7f4c64173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 -- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c641131c0 msgr2=0x7f4c64173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c641131c0 0x7f4c64173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 -- 10.20.193.154:0/3579497722 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5400a660 con 0x7f4c640f50d0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c62ffd6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c6410cfb0 0x7f4c640f4aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c627fc6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c641131c0 0x7f4c64173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c637fe6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c640f50d0 0x7f4c640fa3a0 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c540054e0 tx=0x7f4c54005510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c5bfff6c0 1 -- 10.20.193.154:0/3579497722 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c54003a30 con 0x7f4c640f50d0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c640fad20 con 0x7f4c640f50d0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c5bfff6c0 1 -- 10.20.193.154:0/3579497722 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4c54003b90 con 0x7f4c640f50d0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c5bfff6c0 1 -- 10.20.193.154:0/3579497722 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4c54038380 con 0x7f4c640f50d0 2026-02-13T02:40:02.008 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c640fb1a0 con 0x7f4c640f50d0 2026-02-13T02:40:02.009 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.005+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c6410e280 con 0x7f4c640f50d0 2026-02-13T02:40:02.009 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.007+0000 7f4c5bfff6c0 1 -- 10.20.193.154:0/3579497722 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f4c54003d00 con 0x7f4c640f50d0 2026-02-13T02:40:02.010 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.007+0000 7f4c5bfff6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4c2c0b5640 0x7f4c2c0d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:02.010 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.007+0000 7f4c5bfff6c0 1 -- 10.20.193.154:0/3579497722 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1896+0+0 (secure 0 0 0) 0x7f4c54107580 con 0x7f4c640f50d0 2026-02-13T02:40:02.010 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.008+0000 7f4c62ffd6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4c2c0b5640 0x7f4c2c0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:02.011 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.008+0000 7f4c62ffd6c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4c2c0b5640 0x7f4c2c0d5af0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c50004750 tx=0x7f4c50005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:02.011 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.008+0000 7f4c5bfff6c0 1 -- 10.20.193.154:0/3579497722 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4c540cb910 con 0x7f4c640f50d0 2026-02-13T02:40:02.110 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:02.107+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f4c640f5c50 con 0x7f4c2c0b5640 2026-02-13T02:40:02.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:02.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:02.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:02.948 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:02 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1[33516]: 2026-02-13T02:40:02.667+0000 7f39f07986c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T02:40:02.948 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:02 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1[33516]: 2026-02-13T02:40:02.670+0000 7f39e86546c0 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:40:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T02:40:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T02:40:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:02.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:02.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:02.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:02.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:02.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:03.000 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:03.000 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T02:40:03.000 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:03.001 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:03.002 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/3898528689' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"} : dispatch 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"} : dispatch 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"}]': finished 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] boot 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T02:40:03.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:03.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:03.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/913121882' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:03.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:03.948 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:03 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T02:40:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/3898528689' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"} : dispatch 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"} : dispatch 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"}]': finished 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] boot 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/913121882' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:03.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:03 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:04.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/3898528689' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"} : dispatch 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"} : dispatch 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2697034a-905b-4bdb-adb4-4f945060e9e9"}]': finished 2026-02-13T02:40:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: osd.1 [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] boot 2026-02-13T02:40:04.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T02:40:04.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:40:04.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:04.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/913121882' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:04.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:04.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:03 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:05.176 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:40:05.176 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:40:05.176 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T02:40:05.176 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:05.176 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: pgmap v19: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:05.176 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:05.177 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:04 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:40:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:40:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T02:40:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: pgmap v19: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:05.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:04 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: pgmap v19: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:05.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:05.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:05.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:05.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:05.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:04 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:05.983 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:05 trial154 ceph-mon[27921]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:05.984 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:05 trial154 ceph-mon[27921]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:05.984 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:05 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T02:40:05.984 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:05 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:05.984 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:05 trial154 ceph-mon[27921]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:06.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:05 trial091 ceph-mon[27614]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:06.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:05 trial091 ceph-mon[27614]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:06.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:05 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T02:40:06.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:05 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:06.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:05 trial091 ceph-mon[27614]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:05 trial078 ceph-mon[22944]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:05 trial078 ceph-mon[22944]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:05 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T02:40:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:05 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:05 trial078 ceph-mon[22944]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:07.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:06 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:07.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:06 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:07.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:06 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:08.066 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.063+0000 7f4c5bfff6c0 1 -- 10.20.193.154:0/3579497722 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f4c640f5c50 con 0x7f4c2c0b5640 2026-02-13T02:40:08.067 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 2 on host 'trial154' 2026-02-13T02:40:08.069 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4c2c0b5640 msgr2=0x7f4c2c0d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4c2c0b5640 0x7f4c2c0d5af0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c50004750 tx=0x7f4c50005f10 comp rx=0 tx=0).stop 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c640f50d0 msgr2=0x7f4c640fa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c640f50d0 0x7f4c640fa3a0 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c540054e0 tx=0x7f4c54005510 comp rx=0 tx=0).stop 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 shutdown_connections 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4c2c0b5640 0x7f4c2c0d5af0 unknown :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c640f50d0 0x7f4c640fa3a0 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c641131c0 0x7f4c64173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 --2- 10.20.193.154:0/3579497722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c6410cfb0 0x7f4c640f4aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 >> 10.20.193.154:0/3579497722 conn(0x7f4c640ea8b0 msgr2=0x7f4c6410e770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:08.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 shutdown_connections 2026-02-13T02:40:08.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:08.066+0000 7f4c694386c0 1 -- 10.20.193.154:0/3579497722 wait complete. 2026-02-13T02:40:08.111 DEBUG:teuthology.orchestra.run.trial154:osd.2> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.2.service 2026-02-13T02:40:08.114 INFO:tasks.cephadm:Deploying osd.3 on trial078 with /dev/vg_nvme/lv_3... 2026-02-13T02:40:08.114 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T02:40:08.169 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:08.169 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:08.170 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:08.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:08.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:08.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:08.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:08.197 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:08.198 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:08.199 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:08.303 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:40:08.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: from='osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:40:08.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:40:08.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:08.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:08.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:08.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:08.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:08 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: from='osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:08 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:09.178 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: from='osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:08 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:09.203 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_3 --skip-validation 2026-02-13T02:40:09.388 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:40:09.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 -- 10.20.193.78:0/3384384110 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b010f060 msgr2=0x7f26b010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:09.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/3384384110 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b010f060 0x7f26b010f430 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=5339224060316018091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26a00099a0 tx=0x7f26a002ed00 comp rx=0 tx=0).stop 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 -- 10.20.193.78:0/3384384110 shutdown_connections 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/3384384110 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f26b0115270 0x7f26b0175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/3384384110 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010fa50 0x7f26b0114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/3384384110 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b010f060 0x7f26b010f430 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=5339224060316018091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 -- 10.20.193.78:0/3384384110 >> 10.20.193.78:0/3384384110 conn(0x7f26b00ec980 msgr2=0x7f26b010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 -- 10.20.193.78:0/3384384110 shutdown_connections 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.587+0000 7f26b64d26c0 1 -- 10.20.193.78:0/3384384110 wait complete. 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 Processor -- start 2026-02-13T02:40:09.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 -- start start 2026-02-13T02:40:09.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010f060 0x7f26b011cf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:09.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f26b0115270 0x7f26b011d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:09.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b0122880 0x7f26b0122d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:09.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0123290 con 0x7f26b0122880 2026-02-13T02:40:09.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f26b0123400 con 0x7f26b0115270 2026-02-13T02:40:09.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b64d26c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26b01235c0 con 0x7f26b010f060 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b54d06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010f060 0x7f26b011cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b5cd16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b0122880 0x7f26b0122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b54d06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010f060 0x7f26b011cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:34544/0 (socket says 10.20.193.78:34544) 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b54d06c0 1 -- 10.20.193.78:0/1195380094 learned_addr learned my addr 10.20.193.78:0/1195380094 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.588+0000 7f26b4ccf6c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f26b0115270 0x7f26b011d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b54d06c0 1 -- 10.20.193.78:0/1195380094 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f26b0115270 msgr2=0x7f26b011d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b54d06c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f26b0115270 0x7f26b011d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b54d06c0 1 -- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b0122880 msgr2=0x7f26b0122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b54d06c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b0122880 0x7f26b0122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b54d06c0 1 -- 10.20.193.78:0/1195380094 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a0009590 con 0x7f26b010f060 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b5cd16c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b0122880 0x7f26b0122d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:40:09.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b54d06c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010f060 0x7f26b011cf80 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26a0031fd0 tx=0x7f26a002fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:09.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26a0002ae0 con 0x7f26b010f060 2026-02-13T02:40:09.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b0163a10 con 0x7f26b010f060 2026-02-13T02:40:09.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f26a0007740 con 0x7f26b010f060 2026-02-13T02:40:09.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26a00375c0 con 0x7f26b010f060 2026-02-13T02:40:09.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.589+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b0163e90 con 0x7f26b010f060 2026-02-13T02:40:09.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.590+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b0110330 con 0x7f26b010f060 2026-02-13T02:40:09.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.592+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f26a0002c40 con 0x7f26b010f060 2026-02-13T02:40:09.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.594+0000 7f269e7fc6c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f268c0b5640 0x7f268c0d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:09.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.594+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2436+0+0 (secure 0 0 0) 0x7f26a0106450 con 0x7f26b010f060 2026-02-13T02:40:09.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.594+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f26a0106880 con 0x7f26b010f060 2026-02-13T02:40:09.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.594+0000 7f26b4ccf6c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f268c0b5640 0x7f268c0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:09.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.595+0000 7f26b4ccf6c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f268c0b5640 0x7f268c0d5af0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b0123910 tx=0x7f26a40093f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:09.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:09.699+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f26b011e0d0 con 0x7f268c0b5640 2026-02-13T02:40:09.934 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.935 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:09.936 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:09.937 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:09 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:10.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T02:40:10.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T02:40:10.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:10.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:10.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:10.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:10.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.199 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:10.199 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:10.199 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:09 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.266 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2[34030]: 2026-02-13T02:40:09.923+0000 7f6fb9d9e6c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T02:40:10.266 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2[34030]: 2026-02-13T02:40:09.927+0000 7f6fb1c5a6c0 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:40:10.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:10.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:10.269 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:09 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:11.060 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:11.060 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:11.060 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:40:11.060 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T02:40:11.061 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:11.061 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:11.061 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:11.061 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:10 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:11.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:11.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:11.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:40:11.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T02:40:11.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:11.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:11.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:11.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:10 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:11.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: pgmap v28: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:11.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:11.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:40:11.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T02:40:11.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:11.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:11.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:11.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:10 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:12.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:40:12.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:40:12.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] boot 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: osdmap e15: 3 total, 3 up, 3 in 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3230824084' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "520c54bf-23d1-4eee-9bb8-a89711e96784"} : dispatch 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3230824084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "520c54bf-23d1-4eee-9bb8-a89711e96784"}]': finished 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:40:12.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:11 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1226925477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:40:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:40:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] boot 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: osdmap e15: 3 total, 3 up, 3 in 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3230824084' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "520c54bf-23d1-4eee-9bb8-a89711e96784"} : dispatch 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3230824084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "520c54bf-23d1-4eee-9bb8-a89711e96784"}]': finished 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:40:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:11 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1226925477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:12.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:40:12.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: osd.2 [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] boot 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: osdmap e15: 3 total, 3 up, 3 in 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3230824084' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "520c54bf-23d1-4eee-9bb8-a89711e96784"} : dispatch 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3230824084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "520c54bf-23d1-4eee-9bb8-a89711e96784"}]': finished 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T02:40:12.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:12.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:40:12.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:11 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1226925477' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:12.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40458]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T02:40:12.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40458]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40458]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40462]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T02:40:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40462]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40462]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:12.728 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40074]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T02:40:12.728 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40074]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.728 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.728 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40074]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:12.729 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40082]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T02:40:12.729 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40082]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.729 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.729 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:40:12 trial078 sudo[40082]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:12.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T02:40:12.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36661]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:12.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36665]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T02:40:12.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36665]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36665]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:12.946 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T02:40:12.947 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.947 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.947 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36653]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:12.947 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36657]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T02:40:12.947 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36657]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:12.947 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:12.947 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:40:12 trial091 sudo[36657]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37181]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37181]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37181]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37185]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37185]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37185]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37173]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37177]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37177]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:40:13.017 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:40:12 trial154 sudo[37177]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:40:13.431 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: pgmap v33: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:13.431 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.432 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: pgmap v33: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: pgmap v33: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:40:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:40:13.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:13.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:13.774+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f26a00ca1a0 con 0x7f26b010f060 2026-02-13T02:40:14.340 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:14 trial078 ceph-mon[22944]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T02:40:14.341 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:14.341 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:14 trial078 ceph-mon[22944]: mgrmap e15: x(active, since 38s), standbys: y, z 2026-02-13T02:40:14.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:14 trial091 ceph-mon[27614]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T02:40:14.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:14.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:14 trial091 ceph-mon[27614]: mgrmap e15: x(active, since 38s), standbys: y, z 2026-02-13T02:40:14.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:14 trial154 ceph-mon[27921]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T02:40:14.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:14.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:14 trial154 ceph-mon[27921]: mgrmap e15: x(active, since 38s), standbys: y, z 2026-02-13T02:40:15.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:15 trial078 ceph-mon[22944]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:15.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:15 trial078 ceph-mon[22944]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:15.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:15 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T02:40:15.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:15 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:15.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:15 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:15.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:15 trial091 ceph-mon[27614]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:15.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:15 trial091 ceph-mon[27614]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:15.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:15 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T02:40:15.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:15 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:15.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:15 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:15.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:15 trial154 ceph-mon[27921]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:15.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:15 trial154 ceph-mon[27921]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:15.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:15 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T02:40:15.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:15 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:15.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:15 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:16.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:16 trial078 ceph-mon[22944]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T02:40:16.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:16.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:16 trial091 ceph-mon[27614]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T02:40:16.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:16.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:16 trial154 ceph-mon[27921]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T02:40:16.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:17.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:17 trial091 ceph-mon[27614]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:17.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:17 trial078 ceph-mon[22944]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:17.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:17 trial154 ceph-mon[27921]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:19.344 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:19 trial078 ceph-mon[22944]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:19.345 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:19.345 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:19.345 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:19.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:19 trial091 ceph-mon[27614]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:19.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:19.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:19.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:19.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:19 trial154 ceph-mon[27921]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:19.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:19.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:19.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:19.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.591+0000 7f26b6f5a6c0 1 -- 10.20.193.78:0/1195380094 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7f2688003570 con 0x7f26b010f060 2026-02-13T02:40:19.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.591+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mon.1 v2:10.20.193.154:3300/0 8 ==== osd_map(14..19 src has 1..19) ==== 4055+0+0 (secure 0 0 0) 0x7f26a00ce930 con 0x7f26b010f060 2026-02-13T02:40:19.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.780+0000 7f269e7fc6c0 1 -- 10.20.193.78:0/1195380094 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f26b011e0d0 con 0x7f268c0b5640 2026-02-13T02:40:19.783 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 3 on host 'trial078' 2026-02-13T02:40:19.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.783+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f268c0b5640 msgr2=0x7f268c0d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:19.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.783+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f268c0b5640 0x7f268c0d5af0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b0123910 tx=0x7f26a40093f0 comp rx=0 tx=0).stop 2026-02-13T02:40:19.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.783+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010f060 msgr2=0x7f26b011cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:19.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.783+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010f060 0x7f26b011cf80 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26a0031fd0 tx=0x7f26a002fc60 comp rx=0 tx=0).stop 2026-02-13T02:40:19.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.784+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 shutdown_connections 2026-02-13T02:40:19.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.784+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f268c0b5640 0x7f268c0d5af0 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:19.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.784+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26b0122880 0x7f26b0122d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:19.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.784+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f26b0115270 0x7f26b011d4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:19.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.784+0000 7f26b64d26c0 1 --2- 10.20.193.78:0/1195380094 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f26b010f060 0x7f26b011cf80 unknown :-1 s=CLOSED pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:19.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.784+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 >> 10.20.193.78:0/1195380094 conn(0x7f26b00ec980 msgr2=0x7f26b010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:19.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.785+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 shutdown_connections 2026-02-13T02:40:19.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:19.785+0000 7f26b64d26c0 1 -- 10.20.193.78:0/1195380094 wait complete. 2026-02-13T02:40:19.889 DEBUG:teuthology.orchestra.run.trial078:osd.3> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.3.service 2026-02-13T02:40:19.893 INFO:tasks.cephadm:Deploying osd.4 on trial091 with /dev/vg_nvme/lv_3... 2026-02-13T02:40:19.894 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T02:40:20.015 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:40:20.168 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:20.169 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.170 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:40:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.464 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:40:20.481 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_3 --skip-validation 2026-02-13T02:40:20.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:40:20.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:20.601 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/3244148115 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810fbf0 msgr2=0x7fb1b8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/3244148115 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810fbf0 0x7fb1b8114c30 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=14839629604201157217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1a0009970 tx=0x7fb1a002ed20 comp rx=0 tx=0).stop 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/3244148115 shutdown_connections 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/3244148115 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb1b8115410 0x7fb1b8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/3244148115 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810fbf0 0x7fb1b8114c30 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=14839629604201157217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/3244148115 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb1b810f200 0x7fb1b810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/3244148115 >> 10.20.193.91:0/3244148115 conn(0x7fb1b80ecb00 msgr2=0x7fb1b810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/3244148115 shutdown_connections 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.716+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/3244148115 wait complete. 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 Processor -- start 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 -- start start 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810f200 0x7fb1b80f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb1b8115410 0x7fb1b8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb1b80f5120 0x7fb1b80fa3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b80f5810 con 0x7fb1b80f5120 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b80fa8e0 con 0x7fb1b810f200 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b80faaa0 con 0x7fb1b8115410 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810f200 0x7fb1b80f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810f200 0x7fb1b80f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:32772/0 (socket says 10.20.193.91:32772) 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 -- 10.20.193.91:0/2516365651 learned_addr learned my addr 10.20.193.91:0/2516365651 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd0996c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb1b8115410 0x7fb1b8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1be09b6c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb1b80f5120 0x7fb1b80fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 -- 10.20.193.91:0/2516365651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb1b8115410 msgr2=0x7fb1b8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb1b8115410 0x7fb1b8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 -- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb1b80f5120 msgr2=0x7fb1b80fa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb1b80f5120 0x7fb1b80fa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 -- 10.20.193.91:0/2516365651 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a0009590 con 0x7fb1b810f200 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd0996c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb1b8115410 0x7fb1b8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bd89a6c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810f200 0x7fb1b80f4af0 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1a400b740 tx=0x7fb1a400bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1b6ffd6c0 1 -- 10.20.193.91:0/2516365651 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1a4004250 con 0x7fb1b810f200 2026-02-13T02:40:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1b6ffd6c0 1 -- 10.20.193.91:0/2516365651 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb1a4009070 con 0x7fb1b810f200 2026-02-13T02:40:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b80fad80 con 0x7fb1b810f200 2026-02-13T02:40:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1b6ffd6c0 1 -- 10.20.193.91:0/2516365651 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1a400cde0 con 0x7fb1b810f200 2026-02-13T02:40:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.717+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b80fb510 con 0x7fb1b810f200 2026-02-13T02:40:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.718+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b81104d0 con 0x7fb1b810f200 2026-02-13T02:40:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.719+0000 7fb1b6ffd6c0 1 -- 10.20.193.91:0/2516365651 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb1a40028c0 con 0x7fb1b810f200 2026-02-13T02:40:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.720+0000 7fb1b6ffd6c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb1800b56d0 0x7fb1800d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.720+0000 7fb1b6ffd6c0 1 -- 10.20.193.91:0/2516365651 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3365+0+0 (secure 0 0 0) 0x7fb1a40e27c0 con 0x7fb1b810f200 2026-02-13T02:40:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.720+0000 7fb1bd0996c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb1800b56d0 0x7fb1800d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.721+0000 7fb1bd0996c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb1800b56d0 0x7fb1800d5b80 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b80fb430 tx=0x7fb1a00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.721+0000 7fb1b6ffd6c0 1 -- 10.20.193.91:0/2516365651 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb1a40a64b0 con 0x7fb1b810f200 2026-02-13T02:40:20.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:20.819+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb1b80f5c20 con 0x7fb1800b56d0 2026-02-13T02:40:21.225 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T02:40:21.225 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T02:40:21.225 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:21.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:21.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:40:21 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3[41749]: 2026-02-13T02:40:21.054+0000 7f75df5fd6c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T02:40:21.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:40:21 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3[41749]: 2026-02-13T02:40:21.059+0000 7f75d74b96c0 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:40:21.315 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T02:40:21.315 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T02:40:21.315 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:21.315 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:21.315 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:21.315 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:21.316 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:21.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T02:40:21.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:21.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:21.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:22.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:22.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:40:22.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"} : dispatch 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/3664170774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"} : dispatch 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"}]': finished 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] boot 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:22.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:22.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:22 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/1867089663' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:22.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:22.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:40:22.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T02:40:22.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"} : dispatch 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/3664170774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"} : dispatch 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"}]': finished 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] boot 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:22.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:22.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:22.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:22.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:22.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:22.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:22 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/1867089663' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:22.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"} : dispatch 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/3664170774' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"} : dispatch 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4c56acb-cf6d-4fb7-a682-d848d6b2651b"}]': finished 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: osd.3 [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] boot 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:40:22.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:22.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:22 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/1867089663' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:23.304 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:23 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:40:23.304 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:23 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:40:23.304 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:23 trial091 ceph-mon[27614]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:23.304 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:23 trial091 ceph-mon[27614]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T02:40:23.304 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:23 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:23.304 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:23 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:23.304 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:23 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:23 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:40:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:23 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:40:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:23 trial078 ceph-mon[22944]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:23 trial078 ceph-mon[22944]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T02:40:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:23 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:23 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:23 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:23.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:23 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:40:23.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:23 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:40:23.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:23 trial154 ceph-mon[27921]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:40:23.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:23 trial154 ceph-mon[27921]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T02:40:23.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:23 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:23.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:23 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:23.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:23 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:24.139 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:40:24.139 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:24.139 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.139 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T02:40:24.140 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:40:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T02:40:24.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:24.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:24.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:24.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T02:40:24.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:24.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T02:40:24.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:25.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:25 trial091 ceph-mon[27614]: pgmap v51: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:25.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:25 trial078 ceph-mon[22944]: pgmap v51: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:25.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:25 trial154 ceph-mon[27921]: pgmap v51: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:26 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:26 trial091 ceph-mon[27614]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T02:40:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:26 trial091 ceph-mon[27614]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T02:40:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:26.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:26 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:26 trial078 ceph-mon[22944]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T02:40:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:26 trial078 ceph-mon[22944]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T02:40:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:26.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:26.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:26 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:26.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:26 trial154 ceph-mon[27921]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T02:40:26.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:26 trial154 ceph-mon[27921]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T02:40:26.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:26.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:26.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:26.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.028+0000 7fb1b6ffd6c0 1 -- 10.20.193.91:0/2516365651 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb1b80f5c20 con 0x7fb1800b56d0 2026-02-13T02:40:27.030 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 4 on host 'trial091' 2026-02-13T02:40:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb1800b56d0 msgr2=0x7fb1800d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb1800b56d0 0x7fb1800d5b80 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b80fb430 tx=0x7fb1a00023a0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810f200 msgr2=0x7fb1b80f4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810f200 0x7fb1b80f4af0 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1a400b740 tx=0x7fb1a400bc10 comp rx=0 tx=0).stop 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 shutdown_connections 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb1800b56d0 0x7fb1800d5b80 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb1b80f5120 0x7fb1b80fa3a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb1b8115410 0x7fb1b8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 --2- 10.20.193.91:0/2516365651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb1b810f200 0x7fb1b80f4af0 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 >> 10.20.193.91:0/2516365651 conn(0x7fb1b80ecb00 msgr2=0x7fb1b810d720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 shutdown_connections 2026-02-13T02:40:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:27.031+0000 7fb1bfb296c0 1 -- 10.20.193.91:0/2516365651 wait complete. 2026-02-13T02:40:27.076 DEBUG:teuthology.orchestra.run.trial091:osd.4> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.4.service 2026-02-13T02:40:27.078 INFO:tasks.cephadm:Deploying osd.5 on trial154 with /dev/vg_nvme/lv_3... 2026-02-13T02:40:27.078 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T02:40:27.114 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T02:40:27.114 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: pgmap v54: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: pgmap v55: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:27.115 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:40:27.116 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:40:27.116 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.116 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.196 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: pgmap v54: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:27.335 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: pgmap v55: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.336 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: pgmap v54: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: pgmap v55: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:27.620 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:40:27.638 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_3 --skip-validation 2026-02-13T02:40:27.755 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 -- 10.20.193.154:0/3045876854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c10fc20 msgr2=0x7f407c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 --2- 10.20.193.154:0/3045876854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c10fc20 0x7f407c114c60 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=17195116487691183284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40640099a0 tx=0x7f406402ed20 comp rx=0 tx=0).stop 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 -- 10.20.193.154:0/3045876854 shutdown_connections 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 --2- 10.20.193.154:0/3045876854 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f407c115440 0x7f407c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 --2- 10.20.193.154:0/3045876854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c10fc20 0x7f407c114c60 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=17195116487691183284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 --2- 10.20.193.154:0/3045876854 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f407c10f230 0x7f407c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 -- 10.20.193.154:0/3045876854 >> 10.20.193.154:0/3045876854 conn(0x7f407c0ecb30 msgr2=0x7f407c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 -- 10.20.193.154:0/3045876854 shutdown_connections 2026-02-13T02:40:27.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 -- 10.20.193.154:0/3045876854 wait complete. 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 Processor -- start 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 -- start start 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.871+0000 7f4082d206c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f407c10f230 0x7f407c0f4b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c115440 0x7f407c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f407c0f5170 0x7f407c0fa440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f407c0f5860 con 0x7f407c10f230 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f407c0fa980 con 0x7f407c0f5170 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f407c0fab40 con 0x7f407c115440 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c115440 0x7f407c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c115440 0x7f407c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:40646/0 (socket says 10.20.193.154:40646) 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 -- 10.20.193.154:0/2172696249 learned_addr learned my addr 10.20.193.154:0/2172696249 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T02:40:27.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 -- 10.20.193.154:0/2172696249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f407c0f5170 msgr2=0x7f407c0fa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f407c0f5170 0x7f407c0fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 -- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f407c10f230 msgr2=0x7f407c0f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f407c10f230 0x7f407c0f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 -- 10.20.193.154:0/2172696249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4064009590 con 0x7f407c115440 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f407bfff6c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c115440 0x7f407c175ce0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f406402f970 tx=0x7f40640047f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4079ffb6c0 1 -- 10.20.193.154:0/2172696249 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4064002ae0 con 0x7f407c115440 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4079ffb6c0 1 -- 10.20.193.154:0/2172696249 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4064002c40 con 0x7f407c115440 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4079ffb6c0 1 -- 10.20.193.154:0/2172696249 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4064031290 con 0x7f407c115440 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407c0fadc0 con 0x7f407c115440 2026-02-13T02:40:27.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407c0fb270 con 0x7f407c115440 2026-02-13T02:40:27.879 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.872+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f407c110500 con 0x7f407c115440 2026-02-13T02:40:27.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.874+0000 7f4079ffb6c0 1 -- 10.20.193.154:0/2172696249 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f4064007260 con 0x7f407c115440 2026-02-13T02:40:27.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.874+0000 7f4079ffb6c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f40440b56d0 0x7f40440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:27.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.875+0000 7f4079ffb6c0 1 -- 10.20.193.154:0/2172696249 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3797+0+0 (secure 0 0 0) 0x7f4064106e20 con 0x7f407c115440 2026-02-13T02:40:27.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.875+0000 7f4080a956c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f40440b56d0 0x7f40440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:27.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.875+0000 7f4079ffb6c0 1 -- 10.20.193.154:0/2172696249 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f40640ca920 con 0x7f407c115440 2026-02-13T02:40:27.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.875+0000 7f4080a956c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f40440b56d0 0x7f40440d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4068004750 tx=0x7f4068006d50 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:27.976 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:27.973+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f407c0f5cf0 con 0x7f40440b56d0 2026-02-13T02:40:28.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: pgmap v56: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:28.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:28.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:28.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:28.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:28.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: pgmap v56: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:28.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: pgmap v56: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:28.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:28.945 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:40:28 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4[39769]: 2026-02-13T02:40:28.566+0000 7f8bbc1616c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T02:40:28.946 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:40:28 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4[39769]: 2026-02-13T02:40:28.569+0000 7f8bb401d6c0 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:40:29.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:29.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:29.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:29.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: pgmap v58: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T02:40:29.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/3335275725' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"} : dispatch 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"} : dispatch 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"}]': finished 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] boot 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:29.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:29 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/2191093849' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:29.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:29.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:29.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: pgmap v58: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:29.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/3335275725' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"} : dispatch 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"} : dispatch 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"}]': finished 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] boot 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:29.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:29 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/2191093849' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:29.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:29.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:29.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:29.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:29.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: pgmap v58: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/3335275725' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"} : dispatch 2026-02-13T02:40:29.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"} : dispatch 2026-02-13T02:40:29.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47"}]': finished 2026-02-13T02:40:29.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: osd.4 [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] boot 2026-02-13T02:40:29.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T02:40:29.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:40:29.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:29.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:29 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/2191093849' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:30.345 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:30 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:40:30.345 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:30 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:40:30.346 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:30 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:30.346 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:30 trial154 ceph-mon[27921]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T02:40:30.346 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:30 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:30.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:30 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:40:30.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:30 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:40:30.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:30 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:30.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:30 trial091 ceph-mon[27614]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T02:40:30.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:30 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:30.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:30 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:40:30.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:30 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:40:30.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:30 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:30.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:30 trial078 ceph-mon[22944]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T02:40:30.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:30 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:31.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T02:40:31.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 183 KiB/s, 0 objects/s recovering 2026-02-13T02:40:31.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:31.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:31.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:31.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:31.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T02:40:31.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:31 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T02:40:31.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 183 KiB/s, 0 objects/s recovering 2026-02-13T02:40:31.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:31.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T02:40:31.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:31 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 183 KiB/s, 0 objects/s recovering 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T02:40:31.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:31 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:32 trial091 ceph-mon[27614]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 221 KiB/s, 0 objects/s recovering 2026-02-13T02:40:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:32 trial091 ceph-mon[27614]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T02:40:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:32 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:32 trial091 ceph-mon[27614]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 203 KiB/s, 0 objects/s recovering 2026-02-13T02:40:32.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:32 trial078 ceph-mon[22944]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 221 KiB/s, 0 objects/s recovering 2026-02-13T02:40:32.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:32 trial078 ceph-mon[22944]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T02:40:32.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:32 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:32.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:32 trial078 ceph-mon[22944]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 203 KiB/s, 0 objects/s recovering 2026-02-13T02:40:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:32 trial154 ceph-mon[27921]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 221 KiB/s, 0 objects/s recovering 2026-02-13T02:40:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:32 trial154 ceph-mon[27921]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T02:40:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:32 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:32 trial154 ceph-mon[27921]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 203 KiB/s, 0 objects/s recovering 2026-02-13T02:40:33.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:33 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:33.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:33 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:33.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:33 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:34.147 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 5 on host 'trial154' 2026-02-13T02:40:34.148 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.142+0000 7f4079ffb6c0 1 -- 10.20.193.154:0/2172696249 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f407c0f5cf0 con 0x7f40440b56d0 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f40440b56d0 msgr2=0x7f40440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f40440b56d0 0x7f40440d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4068004750 tx=0x7f4068006d50 comp rx=0 tx=0).stop 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c115440 msgr2=0x7f407c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c115440 0x7f407c175ce0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f406402f970 tx=0x7f40640047f0 comp rx=0 tx=0).stop 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 shutdown_connections 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f40440b56d0 0x7f40440d5b80 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f407c0f5170 0x7f407c0fa440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f407c115440 0x7f407c175ce0 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:34.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 --2- 10.20.193.154:0/2172696249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f407c10f230 0x7f407c0f4b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:34.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 >> 10.20.193.154:0/2172696249 conn(0x7f407c0ecb30 msgr2=0x7f407c10d750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:34.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 shutdown_connections 2026-02-13T02:40:34.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:34.144+0000 7f4082d206c0 1 -- 10.20.193.154:0/2172696249 wait complete. 2026-02-13T02:40:34.190 DEBUG:teuthology.orchestra.run.trial154:osd.5> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.5.service 2026-02-13T02:40:34.192 INFO:tasks.cephadm:Deploying osd.6 on trial078 with /dev/vg_nvme/lv_2... 2026-02-13T02:40:34.192 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T02:40:34.366 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:34.367 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:34.368 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:34.368 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:40:34.368 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:34 trial154 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:40:34.380 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:34.424 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.425 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:34.425 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:34.425 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:34.425 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:40:34.425 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:34 trial078 ceph-mon[22944]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:40:34.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:34.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:34.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:34.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:34.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:34.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:34.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:34.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:34.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:40:34.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:34 trial091 ceph-mon[27614]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:40:35.259 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:40:35.284 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_2 --skip-validation 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:35.336 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T02:40:35.337 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: from='osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:35.337 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T02:40:35.337 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:35.337 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:35 trial078 ceph-mon[22944]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:35.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:35.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:35.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: from='osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:35.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:35 trial091 ceph-mon[27614]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:35.470 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:40:35.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: from='osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:35.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:35 trial154 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:40:35.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.676+0000 7f779f1d36c0 1 -- 10.20.193.78:0/2261911735 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f779810f060 msgr2=0x7f779810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:35.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.676+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/2261911735 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f779810f060 0x7f779810f430 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=4060870259923028376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77880099a0 tx=0x7f778802ed00 comp rx=0 tx=0).stop 2026-02-13T02:40:35.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.676+0000 7f779f1d36c0 1 -- 10.20.193.78:0/2261911735 shutdown_connections 2026-02-13T02:40:35.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.676+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/2261911735 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7798115270 0x7f7798175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.676+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/2261911735 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f779810fa50 0x7f7798114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.676+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/2261911735 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f779810f060 0x7f779810f430 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=4060870259923028376 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.676+0000 7f779f1d36c0 1 -- 10.20.193.78:0/2261911735 >> 10.20.193.78:0/2261911735 conn(0x7f77980ec980 msgr2=0x7f779810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.677+0000 7f779f1d36c0 1 -- 10.20.193.78:0/2261911735 shutdown_connections 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.677+0000 7f779f1d36c0 1 -- 10.20.193.78:0/2261911735 wait complete. 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.677+0000 7f779f1d36c0 1 Processor -- start 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.677+0000 7f779f1d36c0 1 -- start start 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.677+0000 7f779f1d36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f779810f060 0x7f779811d060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:35.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.677+0000 7f779f1d36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7798115270 0x7f779811d5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779f1d36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7798122960 0x7f7798122e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779f1d36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7798123370 con 0x7f7798122960 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779f1d36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f77981234e0 con 0x7f7798115270 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779f1d36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77981236a0 con 0x7f779810f060 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779d9d06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7798115270 0x7f779811d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e9d26c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7798122960 0x7f7798122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779d9d06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7798115270 0x7f779811d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:56356/0 (socket says 10.20.193.78:56356) 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779d9d06c0 1 -- 10.20.193.78:0/1648772848 learned_addr learned my addr 10.20.193.78:0/1648772848 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:40:35.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e1d16c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f779810f060 0x7f779811d060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e9d26c0 1 -- 10.20.193.78:0/1648772848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f779810f060 msgr2=0x7f779811d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e9d26c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f779810f060 0x7f779811d060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e9d26c0 1 -- 10.20.193.78:0/1648772848 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7798115270 msgr2=0x7f779811d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e9d26c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7798115270 0x7f779811d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e9d26c0 1 -- 10.20.193.78:0/1648772848 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7788009590 con 0x7f7798122960 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779e9d26c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7798122960 0x7f7798122e00 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f779400c6c0 tx=0x7f779400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f777f7fe6c0 1 -- 10.20.193.78:0/1648772848 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7794005340 con 0x7f7798122960 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f777f7fe6c0 1 -- 10.20.193.78:0/1648772848 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7794003cf0 con 0x7f7798122960 2026-02-13T02:40:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f777f7fe6c0 1 -- 10.20.193.78:0/1648772848 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f779400dd30 con 0x7f7798122960 2026-02-13T02:40:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.678+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7798163b50 con 0x7f7798122960 2026-02-13T02:40:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.679+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7798163fe0 con 0x7f7798122960 2026-02-13T02:40:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.679+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7798110330 con 0x7f7798122960 2026-02-13T02:40:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.681+0000 7f777f7fe6c0 1 -- 10.20.193.78:0/1648772848 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7794003810 con 0x7f7798122960 2026-02-13T02:40:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.682+0000 7f777f7fe6c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f77740b56d0 0x7f77740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.682+0000 7f777f7fe6c0 1 -- 10.20.193.78:0/1648772848 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4229+0+0 (secure 0 0 0) 0x7f77940e3a30 con 0x7f7798122960 2026-02-13T02:40:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.683+0000 7f777f7fe6c0 1 -- 10.20.193.78:0/1648772848 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77940a7380 con 0x7f7798122960 2026-02-13T02:40:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.683+0000 7f779e1d16c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f77740b56d0 0x7f77740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.683+0000 7f779e1d16c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f77740b56d0 0x7f77740d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7788005b40 tx=0x7f77880023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:35.790 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:35.788+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f779811e250 con 0x7f77740b56d0 2026-02-13T02:40:35.834 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:40:35 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:40:35.769+0000 7f58b6e626c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T02:40:35.834 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:40:35 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:40:35.772+0000 7f58b2d266c0 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:40:36.428 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.429 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.430 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:36.431 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:36.431 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.431 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:36.431 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.431 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:36.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:36.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:36.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:36.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:36.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:36.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:36.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:36.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:37.446 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:40:37.446 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:40:37.446 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:37.446 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:37.446 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:37.446 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:37.446 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] boot 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"} : dispatch 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1530016050' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"} : dispatch 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"}]': finished 2026-02-13T02:40:37.447 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T02:40:37.448 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:37.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:40:37.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:37.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] boot 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"} : dispatch 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1530016050' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"} : dispatch 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"}]': finished 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T02:40:37.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:37.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: osd.5 [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] boot 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: osdmap e33: 6 total, 6 up, 6 in 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"} : dispatch 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1530016050' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"} : dispatch 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0cdd77aa-b764-4477-b092-4863371bead5"}]': finished 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T02:40:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:38 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:38 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:38 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/219057965' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:38 trial091 ceph-mon[27614]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T02:40:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:38 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:38 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:38 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/219057965' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:38 trial078 ceph-mon[22944]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T02:40:38.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:38.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:38 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:38.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:38 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:38.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:38 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/219057965' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:38.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:38 trial154 ceph-mon[27921]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T02:40:38.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:39.596 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:39 trial091 ceph-mon[27614]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:40:39.596 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:39 trial091 ceph-mon[27614]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T02:40:39.596 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:39.666 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:39 trial154 ceph-mon[27921]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:40:39.667 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:39 trial154 ceph-mon[27921]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T02:40:39.667 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:39.718 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:39 trial078 ceph-mon[22944]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:40:39.718 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:39 trial078 ceph-mon[22944]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T02:40:39.718 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:41 trial078 ceph-mon[22944]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 163 KiB/s, 0 objects/s recovering 2026-02-13T02:40:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:41 trial078 ceph-mon[22944]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T02:40:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:41 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T02:40:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:41.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:41 trial091 ceph-mon[27614]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 163 KiB/s, 0 objects/s recovering 2026-02-13T02:40:41.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:41 trial091 ceph-mon[27614]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T02:40:41.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:41.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:41 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:41.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T02:40:41.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:41.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:41 trial154 ceph-mon[27921]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 163 KiB/s, 0 objects/s recovering 2026-02-13T02:40:41.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:41 trial154 ceph-mon[27921]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T02:40:41.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:41.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:41 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:41.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T02:40:41.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:43.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:43 trial091 ceph-mon[27614]: pgmap v81: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 121 KiB/s, 0 objects/s recovering 2026-02-13T02:40:43.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:43 trial078 ceph-mon[22944]: pgmap v81: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 121 KiB/s, 0 objects/s recovering 2026-02-13T02:40:43.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:43 trial154 ceph-mon[27921]: pgmap v81: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 121 KiB/s, 0 objects/s recovering 2026-02-13T02:40:45.141 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:45 trial078 ceph-mon[22944]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T02:40:45.142 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:45.142 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:45.142 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:45.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:45 trial091 ceph-mon[27614]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T02:40:45.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:45.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:45.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:45.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:45 trial154 ceph-mon[27921]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T02:40:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:45.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:45.610 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 6 on host 'trial078' 2026-02-13T02:40:45.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.607+0000 7f777f7fe6c0 1 -- 10.20.193.78:0/1648772848 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f779811e250 con 0x7f77740b56d0 2026-02-13T02:40:45.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f77740b56d0 msgr2=0x7f77740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:45.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f77740b56d0 0x7f77740d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7788005b40 tx=0x7f77880023a0 comp rx=0 tx=0).stop 2026-02-13T02:40:45.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7798122960 msgr2=0x7f7798122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:45.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7798122960 0x7f7798122e00 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f779400c6c0 tx=0x7f779400cb90 comp rx=0 tx=0).stop 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 shutdown_connections 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f77740b56d0 0x7f77740d5b80 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7798122960 0x7f7798122e00 unknown :-1 s=CLOSED pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7798115270 0x7f779811d5a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 --2- 10.20.193.78:0/1648772848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f779810f060 0x7f779811d060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 >> 10.20.193.78:0/1648772848 conn(0x7f77980ec980 msgr2=0x7f779810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 shutdown_connections 2026-02-13T02:40:45.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:40:45.610+0000 7f779f1d36c0 1 -- 10.20.193.78:0/1648772848 wait complete. 2026-02-13T02:40:45.719 DEBUG:teuthology.orchestra.run.trial078:osd.6> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.6.service 2026-02-13T02:40:45.722 INFO:tasks.cephadm:Deploying osd.7 on trial091 with /dev/vg_nvme/lv_2... 2026-02-13T02:40:45.723 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T02:40:45.841 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:40:46.253 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:46 trial091 ceph-mon[27614]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:40:46.253 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:46 trial091 ceph-mon[27614]: from='osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:40:46.253 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.253 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.253 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.253 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.310 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:40:46.327 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_2 --skip-validation 2026-02-13T02:40:46.343 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:46 trial078 ceph-mon[22944]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:40:46.343 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:46 trial078 ceph-mon[22944]: from='osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:40:46.343 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.343 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.343 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.344 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.448 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:40:46.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:46 trial154 ceph-mon[27921]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:40:46.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:46 trial154 ceph-mon[27921]: from='osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:40:46.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:46.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/625219616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d410f200 msgr2=0x7fa2d410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/625219616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d410f200 0x7fa2d410f5d0 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=3447755066593179244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c0009970 tx=0x7fa2c002ed20 comp rx=0 tx=0).stop 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/625219616 shutdown_connections 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/625219616 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2d4115410 0x7fa2d4175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/625219616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2d410fbf0 0x7fa2d4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/625219616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d410f200 0x7fa2d410f5d0 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=3447755066593179244 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/625219616 >> 10.20.193.91:0/625219616 conn(0x7fa2d40ecb00 msgr2=0x7fa2d410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/625219616 shutdown_connections 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.571+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/625219616 wait complete. 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 Processor -- start 2026-02-13T02:40:46.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 -- start start 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2d410f200 0x7fa2d411d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2d4115410 0x7fa2d411d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d4122a50 0x7fa2d4122ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4123460 con 0x7fa2d410f200 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41235d0 con 0x7fa2d4122a50 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4123790 con 0x7fa2d4115410 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d4122a50 0x7fa2d4122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d4122a50 0x7fa2d4122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:53924/0 (socket says 10.20.193.91:53924) 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 -- 10.20.193.91:0/217105662 learned_addr learned my addr 10.20.193.91:0/217105662 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d27fc6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2d4115410 0x7fa2d411d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:46.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 -- 10.20.193.91:0/217105662 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2d4115410 msgr2=0x7fa2d411d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2d4115410 0x7fa2d411d690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 -- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2d410f200 msgr2=0x7fa2d411d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2d410f200 0x7fa2d411d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 -- 10.20.193.91:0/217105662 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c0009590 con 0x7fa2d4122a50 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d27fc6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2d4115410 0x7fa2d411d690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d37fe6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d4122a50 0x7fa2d4122ef0 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c400c6c0 tx=0x7fa2c400cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2cbfff6c0 1 -- 10.20.193.91:0/217105662 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c4003c40 con 0x7fa2d4122a50 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2cbfff6c0 1 -- 10.20.193.91:0/217105662 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa2c400a030 con 0x7fa2d4122a50 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2cbfff6c0 1 -- 10.20.193.91:0/217105662 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa2c400dc10 con 0x7fa2d4122a50 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d4163c40 con 0x7fa2d4122a50 2026-02-13T02:40:46.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.572+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41640d0 con 0x7fa2d4122a50 2026-02-13T02:40:46.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.573+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d41104d0 con 0x7fa2d4122a50 2026-02-13T02:40:46.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.574+0000 7fa2cbfff6c0 1 -- 10.20.193.91:0/217105662 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fa2c4005030 con 0x7fa2d4122a50 2026-02-13T02:40:46.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.575+0000 7fa2cbfff6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa29c0b56d0 0x7fa29c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:46.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.575+0000 7fa2cbfff6c0 1 -- 10.20.193.91:0/217105662 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4661+0+0 (secure 0 0 0) 0x7fa2c40e3cc0 con 0x7fa2d4122a50 2026-02-13T02:40:46.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.575+0000 7fa2cbfff6c0 1 -- 10.20.193.91:0/217105662 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa2c40aa610 con 0x7fa2d4122a50 2026-02-13T02:40:46.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.575+0000 7fa2d2ffd6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa29c0b56d0 0x7fa29c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:46.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.576+0000 7fa2d2ffd6c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa29c0b56d0 0x7fa29c0d5b80 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c00098c0 tx=0x7fa2c0005c40 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:46.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:46.670+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa2d411e340 con 0x7fa29c0b56d0 2026-02-13T02:40:47.312 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T02:40:47.312 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T02:40:47.312 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:47.313 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:47.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T02:40:47.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T02:40:47.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T02:40:47.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:47.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:47.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:47.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:47.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:47.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:47.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:47.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:47.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:47.479 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:40:47 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:40:47.102+0000 7fecc036e6c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T02:40:47.479 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:40:47 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:40:47.109+0000 7fecb822a6c0 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:40:47.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T02:40:47.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='client.24443 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:47.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:48.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:48.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"} : dispatch 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/2780132484' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"} : dispatch 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"}]': finished 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] boot 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T02:40:48.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:48.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:48 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/2126264453' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:48.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:40:48.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T02:40:48.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:48.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"} : dispatch 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/2780132484' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"} : dispatch 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"}]': finished 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] boot 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:48.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:48 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/2126264453' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:48.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:48.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"} : dispatch 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/2780132484' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"} : dispatch 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b26572df-8730-4245-996e-9f6ad280cd39"}]': finished 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: osd.6 [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] boot 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:40:48.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:48.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:48 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/2126264453' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:49.230 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:49 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:40:49.230 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:49 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:40:49.230 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:49 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:49.230 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:49 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:49.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:49 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:40:49.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:49 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:40:49.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:49 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:49.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:49 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:49.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:49 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:40:49.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:49 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:40:49.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:49 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:49.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:49 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:50.284 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T02:40:50.284 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:50.284 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.284 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T02:40:50.285 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T02:40:50.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:50.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T02:40:50.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:50.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:50.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:50.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:50.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T02:40:50.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:51.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:51 trial091 ceph-mon[27614]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:51.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:51 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:51.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:51 trial078 ceph-mon[22944]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:51.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:51 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:51.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:51 trial154 ceph-mon[27921]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:51.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:51 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:52.364 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:52 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:52.365 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:52 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:52.365 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:52 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:52.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:52 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:52.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:52 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:52.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:52 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:52.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:52 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:52.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:52 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:52.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:52 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:52.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.970+0000 7fa2cbfff6c0 1 -- 10.20.193.91:0/217105662 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa2d411e340 con 0x7fa29c0b56d0 2026-02-13T02:40:52.971 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 7 on host 'trial091' 2026-02-13T02:40:52.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa29c0b56d0 msgr2=0x7fa29c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:52.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa29c0b56d0 0x7fa29c0d5b80 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c00098c0 tx=0x7fa2c0005c40 comp rx=0 tx=0).stop 2026-02-13T02:40:52.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d4122a50 msgr2=0x7fa2d4122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:52.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d4122a50 0x7fa2d4122ef0 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2c400c6c0 tx=0x7fa2c400cb90 comp rx=0 tx=0).stop 2026-02-13T02:40:52.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 shutdown_connections 2026-02-13T02:40:52.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa29c0b56d0 0x7fa29c0d5b80 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:52.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2d4122a50 0x7fa2d4122ef0 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:52.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2d4115410 0x7fa2d411d690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:52.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 --2- 10.20.193.91:0/217105662 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2d410f200 0x7fa2d411d150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:52.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 >> 10.20.193.91:0/217105662 conn(0x7fa2d40ecb00 msgr2=0x7fa2d410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:52.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 shutdown_connections 2026-02-13T02:40:52.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:40:52.972+0000 7fa2d93e86c0 1 -- 10.20.193.91:0/217105662 wait complete. 2026-02-13T02:40:53.014 DEBUG:teuthology.orchestra.run.trial091:osd.7> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.7.service 2026-02-13T02:40:53.016 INFO:tasks.cephadm:Deploying osd.8 on trial154 with /dev/vg_nvme/lv_2... 2026-02-13T02:40:53.016 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T02:40:53.137 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:40:53.584 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:40:53.601 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_2 --skip-validation 2026-02-13T02:40:53.721 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:53.819 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:53.820 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:40:53.820 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:40:53.820 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:53.820 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:53.820 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.820 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.820 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:53.836 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:40:53.837 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:53.838 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:53.838 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.838 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.838 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:53.840 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/3919195837 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c10f230 msgr2=0x7f2c8c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/3919195837 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c10f230 0x7f2c8c10f600 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=228517024320546046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c780099a0 tx=0x7f2c7802ed20 comp rx=0 tx=0).stop 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/3919195837 shutdown_connections 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/3919195837 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c8c115440 0x7f2c8c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/3919195837 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c8c10fc20 0x7f2c8c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/3919195837 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c10f230 0x7f2c8c10f600 unknown :-1 s=CLOSED pgs=59 gs=1 cs=0 l=1 c_cookie=228517024320546046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/3919195837 >> 10.20.193.154:0/3919195837 conn(0x7f2c8c0ecb30 msgr2=0x7f2c8c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/3919195837 shutdown_connections 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.833+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/3919195837 wait complete. 2026-02-13T02:40:53.841 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 Processor -- start 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 -- start start 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c8c10f230 0x7f2c8c11d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c115440 0x7f2c8c11d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c8c122ac0 0x7f2c8c122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1234d0 con 0x7f2c8c10f230 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c123640 con 0x7f2c8c122ac0 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c123800 con 0x7f2c8c115440 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c115440 0x7f2c8c11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c115440 0x7f2c8c11d700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:45718/0 (socket says 10.20.193.154:45718) 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 -- 10.20.193.154:0/4069485725 learned_addr learned my addr 10.20.193.154:0/4069485725 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c918d16c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c8c122ac0 0x7f2c8c122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:53.842 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 -- 10.20.193.154:0/4069485725 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c8c122ac0 msgr2=0x7f2c8c122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c8c122ac0 0x7f2c8c122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 -- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c8c10f230 msgr2=0x7f2c8c11d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c8c10f230 0x7f2c8c11d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 -- 10.20.193.154:0/4069485725 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c78009590 con 0x7f2c8c115440 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c908cf6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c115440 0x7f2c8c11d700 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c7400b6c0 tx=0x7f2c7400bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c8a7fc6c0 1 -- 10.20.193.154:0/4069485725 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c740044a0 con 0x7f2c8c115440 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c8a7fc6c0 1 -- 10.20.193.154:0/4069485725 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2c7400be50 con 0x7f2c8c115440 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c163cb0 con 0x7f2c8c115440 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c8a7fc6c0 1 -- 10.20.193.154:0/4069485725 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c7400cd50 con 0x7f2c8c115440 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.834+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c164190 con 0x7f2c8c115440 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.835+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c110500 con 0x7f2c8c115440 2026-02-13T02:40:53.843 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.836+0000 7f2c8a7fc6c0 1 -- 10.20.193.154:0/4069485725 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f2c740026b0 con 0x7f2c8c115440 2026-02-13T02:40:53.844 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.837+0000 7f2c8a7fc6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c540b56d0 0x7f2c540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:40:53.844 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.837+0000 7f2c8a7fc6c0 1 -- 10.20.193.154:0/4069485725 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5093+0+0 (secure 0 0 0) 0x7f2c740e2d40 con 0x7f2c8c115440 2026-02-13T02:40:53.844 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.837+0000 7f2c910d06c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c540b56d0 0x7f2c540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:40:53.845 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.837+0000 7f2c8a7fc6c0 1 -- 10.20.193.154:0/4069485725 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c740a6330 con 0x7f2c8c115440 2026-02-13T02:40:53.845 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.838+0000 7f2c910d06c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c540b56d0 0x7f2c540d5b80 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c780098c0 tx=0x7f2c78005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:40:53.936 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:40:53.932+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f2c8c11e340 con 0x7f2c540b56d0 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:53.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T02:40:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T02:40:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:54.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:54.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:54.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:54.768 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T02:40:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:54.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:54.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.948 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:40:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:40:54.573+0000 7f10ac40d6c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T02:40:54.948 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:40:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:40:54.579+0000 7f10a82d16c0 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:40:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:54.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T02:40:54.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T02:40:54.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:54.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:54.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:40:54.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.979 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:54.980 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/992397688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"} : dispatch 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"} : dispatch 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"}]': finished 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] boot 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T02:40:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:55.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:55.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/395330129' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:55.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:55.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:55 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:40:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T02:40:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/992397688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"} : dispatch 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"} : dispatch 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"}]': finished 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] boot 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/395330129' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:55.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:55 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='client.24460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/992397688' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"} : dispatch 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"} : dispatch 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87ca52a3-dbf2-4405-b992-876c1a7287a1"}]': finished 2026-02-13T02:40:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: osd.7 [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] boot 2026-02-13T02:40:56.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T02:40:56.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:40:56.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:56.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/395330129' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:40:56.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:40:56.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:55 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:57.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:57.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:40:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:40:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T02:40:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:40:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:57.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:40:57.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:40:57.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:40:57.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:40:57.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:57.897 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:57 trial154 ceph-mon[27921]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:57.897 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:57 trial154 ceph-mon[27921]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:57.897 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:57 trial154 ceph-mon[27921]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:57.897 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:57 trial154 ceph-mon[27921]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T02:40:57.897 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:57.897 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T02:40:57.898 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:58.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:57 trial091 ceph-mon[27614]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:58.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:57 trial091 ceph-mon[27614]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:58.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:57 trial091 ceph-mon[27614]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:58.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:57 trial091 ceph-mon[27614]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T02:40:58.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:58.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T02:40:58.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:57 trial078 ceph-mon[22944]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:57 trial078 ceph-mon[22944]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:57 trial078 ceph-mon[22944]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:40:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:57 trial078 ceph-mon[22944]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T02:40:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T02:40:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:40:59.012 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:58 trial154 ceph-mon[27921]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:59.012 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:58 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:59.012 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:58 trial154 ceph-mon[27921]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T02:40:59.012 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:58 trial154 ceph-mon[27921]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T02:40:59.012 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:59.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:58 trial091 ceph-mon[27614]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:59.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:58 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:59.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:58 trial091 ceph-mon[27614]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T02:40:59.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:58 trial091 ceph-mon[27614]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T02:40:59.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:40:59.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:58 trial078 ceph-mon[22944]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:40:59.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:58 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:40:59.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:58 trial078 ceph-mon[22944]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2026-02-13T02:40:59.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:58 trial078 ceph-mon[22944]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T02:40:59.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:59 trial154 ceph-mon[27921]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T02:41:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:40:59 trial154 ceph-mon[27921]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:59 trial091 ceph-mon[27614]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T02:41:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:40:59 trial091 ceph-mon[27614]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:00.199 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.195+0000 7f2c8a7fc6c0 1 -- 10.20.193.154:0/4069485725 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f2c8c11e340 con 0x7f2c540b56d0 2026-02-13T02:41:00.199 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 8 on host 'trial154' 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c540b56d0 msgr2=0x7f2c540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c540b56d0 0x7f2c540d5b80 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c780098c0 tx=0x7f2c78005ae0 comp rx=0 tx=0).stop 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c115440 msgr2=0x7f2c8c11d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c115440 0x7f2c8c11d700 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c7400b6c0 tx=0x7f2c7400bb90 comp rx=0 tx=0).stop 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 shutdown_connections 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c540b56d0 0x7f2c540d5b80 unknown :-1 s=CLOSED pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c8c122ac0 0x7f2c8c122f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c8c115440 0x7f2c8c11d700 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 --2- 10.20.193.154:0/4069485725 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c8c10f230 0x7f2c8c11d1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 >> 10.20.193.154:0/4069485725 conn(0x7f2c8c0ecb30 msgr2=0x7f2c8c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 shutdown_connections 2026-02-13T02:41:00.202 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:00.198+0000 7f2c9335f6c0 1 -- 10.20.193.154:0/4069485725 wait complete. 2026-02-13T02:41:00.226 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:59 trial078 ceph-mon[22944]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T02:41:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:40:59 trial078 ceph-mon[22944]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:00.241 DEBUG:teuthology.orchestra.run.trial154:osd.8> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.8.service 2026-02-13T02:41:00.244 INFO:tasks.cephadm:Deploying osd.9 on trial078 with /dev/vg_nvme/lv_1... 2026-02-13T02:41:00.244 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T02:41:00.433 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:01.116 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: pgmap v110: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:01.117 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:00 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:01.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: pgmap v110: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:01.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:00 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:01.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: pgmap v109: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: pgmap v110: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail; 2/6 objects degraded (33.333%) 2026-02-13T02:41:01.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:00 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:01.307 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:01.330 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_1 --skip-validation 2026-02-13T02:41:01.518 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:01.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.713+0000 7feffffff6c0 1 -- 10.20.193.78:0/935587868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff00011b3f0 msgr2=0x7ff00011b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:01.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.713+0000 7feffffff6c0 1 --2- 10.20.193.78:0/935587868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff00011b3f0 0x7ff00011b7c0 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=4868920318609971611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff4009970 tx=0x7feff402ed20 comp rx=0 tx=0).stop 2026-02-13T02:41:01.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 -- 10.20.193.78:0/935587868 shutdown_connections 2026-02-13T02:41:01.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 --2- 10.20.193.78:0/935587868 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff0001199a0 0x7ff000116df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:01.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 --2- 10.20.193.78:0/935587868 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff000118f30 0x7ff000119380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:01.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 --2- 10.20.193.78:0/935587868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff00011b3f0 0x7ff00011b7c0 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=4868920318609971611 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:01.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 -- 10.20.193.78:0/935587868 >> 10.20.193.78:0/935587868 conn(0x7ff00005b290 msgr2=0x7ff00005b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:01.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 -- 10.20.193.78:0/935587868 shutdown_connections 2026-02-13T02:41:01.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 -- 10.20.193.78:0/935587868 wait complete. 2026-02-13T02:41:01.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.714+0000 7feffffff6c0 1 Processor -- start 2026-02-13T02:41:01.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffffff6c0 1 -- start start 2026-02-13T02:41:01.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff000118f30 0x7ff0000fdcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:01.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0001199a0 0x7ff0000fe230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:01.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff00011b3f0 0x7ff0001035f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:01.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffffff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff000103c40 con 0x7ff0001199a0 2026-02-13T02:41:01.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffffff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff000103db0 con 0x7ff00011b3f0 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffffff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff000103f70 con 0x7ff000118f30 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffeffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff000118f30 0x7ff0000fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffe7fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0001199a0 0x7ff0000fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffeffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff000118f30 0x7ff0000fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:38388/0 (socket says 10.20.193.78:38388) 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7feffeffd6c0 1 -- 10.20.193.78:0/3621299313 learned_addr learned my addr 10.20.193.78:0/3621299313 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.715+0000 7fefff7fe6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff00011b3f0 0x7ff0001035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffe7fc6c0 1 -- 10.20.193.78:0/3621299313 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff000118f30 msgr2=0x7ff0000fdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffe7fc6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff000118f30 0x7ff0000fdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffe7fc6c0 1 -- 10.20.193.78:0/3621299313 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff00011b3f0 msgr2=0x7ff0001035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffe7fc6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff00011b3f0 0x7ff0001035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:01.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffe7fc6c0 1 -- 10.20.193.78:0/3621299313 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff4009590 con 0x7ff0001199a0 2026-02-13T02:41:01.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffe7fc6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0001199a0 0x7ff0000fe230 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe800b6e0 tx=0x7fefe800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:01.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7ff00487f6c0 1 -- 10.20.193.78:0/3621299313 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe8004a80 con 0x7ff0001199a0 2026-02-13T02:41:01.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff000104250 con 0x7ff0001199a0 2026-02-13T02:41:01.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff000104910 con 0x7ff0001199a0 2026-02-13T02:41:01.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7ff00487f6c0 1 -- 10.20.193.78:0/3621299313 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe8009030 con 0x7ff0001199a0 2026-02-13T02:41:01.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.716+0000 7ff00487f6c0 1 -- 10.20.193.78:0/3621299313 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe800cd40 con 0x7ff0001199a0 2026-02-13T02:41:01.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.717+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00005e670 con 0x7ff0001199a0 2026-02-13T02:41:01.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.719+0000 7ff00487f6c0 1 -- 10.20.193.78:0/3621299313 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fefe8005000 con 0x7ff0001199a0 2026-02-13T02:41:01.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.721+0000 7ff00487f6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fefd40b56d0 0x7fefd40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:01.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.721+0000 7ff00487f6c0 1 -- 10.20.193.78:0/3621299313 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5525+0+0 (secure 0 0 0) 0x7fefe80e2f20 con 0x7ff0001199a0 2026-02-13T02:41:01.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.721+0000 7ff00487f6c0 1 -- 10.20.193.78:0/3621299313 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fefe80e33a0 con 0x7ff0001199a0 2026-02-13T02:41:01.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.721+0000 7feffeffd6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fefd40b56d0 0x7fefd40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:01.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.722+0000 7feffeffd6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fefd40b56d0 0x7fefd40d5b80 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff4031fd0 tx=0x7feff4005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:01.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:01.826+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ff000185ef0 con 0x7fefd40b56d0 2026-02-13T02:41:01.942 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:01.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:01.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:01.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:01.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:01.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:01 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.944 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:41:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:41:01.817+0000 7fe7f5f6d6c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T02:41:01.944 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:41:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:41:01.823+0000 7fe7ede296c0 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:41:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T02:41:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T02:41:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:01.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:01 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:02.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:02.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T02:41:02.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T02:41:02.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:02.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:02.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:02.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:02.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:02.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:01 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:41:03.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:03.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T02:41:03.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:02 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:03.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.200 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:03.201 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T02:41:03.201 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:02 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:41:03.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:41:03.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T02:41:03.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:03.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:03.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:03.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:03.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:03.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:03.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:03.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2026-02-13T02:41:03.268 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:02 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:41:04.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:41:04.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:41:04.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] boot 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: osdmap e51: 9 total, 9 up, 9 in 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/718118091' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "771bc3b1-5e53-408b-a87c-9e9a2174df76"} : dispatch 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/718118091' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "771bc3b1-5e53-408b-a87c-9e9a2174df76"}]': finished 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:04.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3879253585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] boot 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: osdmap e51: 9 total, 9 up, 9 in 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/718118091' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "771bc3b1-5e53-408b-a87c-9e9a2174df76"} : dispatch 2026-02-13T02:41:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/718118091' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "771bc3b1-5e53-408b-a87c-9e9a2174df76"}]': finished 2026-02-13T02:41:04.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T02:41:04.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:04.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3879253585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: osd.8 [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] boot 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: osdmap e51: 9 total, 9 up, 9 in 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/718118091' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "771bc3b1-5e53-408b-a87c-9e9a2174df76"} : dispatch 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/718118091' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "771bc3b1-5e53-408b-a87c-9e9a2174df76"}]': finished 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T02:41:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:04.267 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3879253585' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:05.402 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:05 trial078 ceph-mon[22944]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:05.402 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:05 trial078 ceph-mon[22944]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T02:41:05.403 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:05 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:05.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:05 trial091 ceph-mon[27614]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:05.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:05 trial091 ceph-mon[27614]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T02:41:05.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:05 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:05.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:05 trial154 ceph-mon[27921]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:05.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:05 trial154 ceph-mon[27921]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T02:41:05.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:05 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:06 trial078 ceph-mon[22944]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T02:41:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:06 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:06.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:06 trial091 ceph-mon[27614]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T02:41:06.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:06 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:06.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:06 trial154 ceph-mon[27921]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T02:41:06.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:06 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:07.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:07 trial078 ceph-mon[22944]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:41:07.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:07 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:07.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:07 trial078 ceph-mon[22944]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T02:41:07.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:07.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T02:41:07.199 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:07 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:07.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:07 trial091 ceph-mon[27614]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:41:07.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:07 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:07.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:07 trial091 ceph-mon[27614]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T02:41:07.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:07.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T02:41:07.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:07 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:07.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:07 trial154 ceph-mon[27921]: pgmap v121: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:41:07.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:07 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:07.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:07 trial154 ceph-mon[27921]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T02:41:07.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:07.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T02:41:07.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:07 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:09.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:09 trial091 ceph-mon[27614]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T02:41:09.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:09 trial078 ceph-mon[22944]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T02:41:09.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:09 trial154 ceph-mon[27921]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T02:41:10.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:10 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:10.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:10 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:10.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:10 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:10.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:10 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:10.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:10 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:10.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:10 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:10.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:10 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:10.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:10 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:10.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:10 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:11.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:11 trial091 ceph-mon[27614]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T02:41:11.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:11 trial091 ceph-mon[27614]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:41:11.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:11 trial091 ceph-mon[27614]: from='osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:41:11.457 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:11 trial078 ceph-mon[22944]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T02:41:11.457 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:11 trial078 ceph-mon[22944]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:41:11.457 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:11 trial078 ceph-mon[22944]: from='osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:41:11.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:11 trial154 ceph-mon[27921]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 100 KiB/s, 0 objects/s recovering 2026-02-13T02:41:11.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:11 trial154 ceph-mon[27921]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:41:11.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:11 trial154 ceph-mon[27921]: from='osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:41:11.605 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 9 on host 'trial078' 2026-02-13T02:41:11.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.603+0000 7ff00487f6c0 1 -- 10.20.193.78:0/3621299313 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ff000185ef0 con 0x7fefd40b56d0 2026-02-13T02:41:11.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fefd40b56d0 msgr2=0x7fefd40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:11.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fefd40b56d0 0x7fefd40d5b80 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff4031fd0 tx=0x7feff4005ae0 comp rx=0 tx=0).stop 2026-02-13T02:41:11.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0001199a0 msgr2=0x7ff0000fe230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:11.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0001199a0 0x7ff0000fe230 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe800b6e0 tx=0x7fefe800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 shutdown_connections 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fefd40b56d0 0x7fefd40d5b80 unknown :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff00011b3f0 0x7ff0001035f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0001199a0 0x7ff0000fe230 unknown :-1 s=CLOSED pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 --2- 10.20.193.78:0/3621299313 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff000118f30 0x7ff0000fdcf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 >> 10.20.193.78:0/3621299313 conn(0x7ff00005b290 msgr2=0x7ff0000f84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 shutdown_connections 2026-02-13T02:41:11.608 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:11.606+0000 7feffffff6c0 1 -- 10.20.193.78:0/3621299313 wait complete. 2026-02-13T02:41:11.713 DEBUG:teuthology.orchestra.run.trial078:osd.9> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.9.service 2026-02-13T02:41:11.717 INFO:tasks.cephadm:Deploying osd.10 on trial091 with /dev/vg_nvme/lv_1... 2026-02-13T02:41:11.717 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T02:41:11.838 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:41:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T02:41:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T02:41:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:41:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:12.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 94 KiB/s, 0 objects/s recovering 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:41:12.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:12 trial078 ceph-mon[22944]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T02:41:12.228 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:41:12 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:41:12.158+0000 7f999fa436c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T02:41:12.229 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:41:12 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:41:12.167+0000 7f99978ff6c0 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:41:12.283 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T02:41:12.301 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_1 --skip-validation 2026-02-13T02:41:12.305 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T02:41:12.305 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T02:41:12.305 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:41:12.305 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 94 KiB/s, 0 objects/s recovering 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:41:12.306 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:12 trial091 ceph-mon[27614]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T02:41:12.417 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.b/config 2026-02-13T02:41:12.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T02:41:12.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T02:41:12.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:41:12.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:12.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:41:12.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 94 KiB/s, 0 objects/s recovering 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:41:12.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:12 trial154 ceph-mon[27921]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T02:41:12.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1164037573 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c115440 msgr2=0x7f3c1c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:12.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1164037573 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c115440 0x7f3c1c175de0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=16770722865377357700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c00aa40 tx=0x7f3c0c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:41:12.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1164037573 shutdown_connections 2026-02-13T02:41:12.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1164037573 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c115440 0x7f3c1c175de0 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=16770722865377357700 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:12.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1164037573 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1c10fc20 0x7f3c1c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1164037573 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3c1c10f230 0x7f3c1c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1164037573 >> 10.20.193.91:0/1164037573 conn(0x7f3c1c0ecb30 msgr2=0x7f3c1c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1164037573 shutdown_connections 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1164037573 wait complete. 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 Processor -- start 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- start start 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3c1c10f230 0x7f3c1c11d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1c115440 0x7f3c1c11d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c1229b0 0x7f3c1c122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1233c0 con 0x7f3c1c10f230 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c123530 con 0x7f3c1c1229b0 2026-02-13T02:41:12.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.540+0000 7f3c212b96c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1c1236f0 con 0x7f3c1c115440 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c1229b0 0x7f3c1c122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c1229b0 0x7f3c1c122e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:33402/0 (socket says 10.20.193.91:33402) 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 -- 10.20.193.91:0/1895323697 learned_addr learned my addr 10.20.193.91:0/1895323697 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1affd6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3c1c10f230 0x7f3c1c11d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 -- 10.20.193.91:0/1895323697 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1c115440 msgr2=0x7f3c1c11d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1c115440 0x7f3c1c11d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 -- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3c1c10f230 msgr2=0x7f3c1c11d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3c1c10f230 0x7f3c1c11d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 -- 10.20.193.91:0/1895323697 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c00a660 con 0x7f3c1c1229b0 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1affd6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3c1c10f230 0x7f3c1c11d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:41:12.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c1b7fe6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c1229b0 0x7f3c1c122e50 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c00a390 tx=0x7f3c0c005530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:12.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c13fff6c0 1 -- 10.20.193.91:0/1895323697 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c0c030da0 con 0x7f3c1c1229b0 2026-02-13T02:41:12.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c13fff6c0 1 -- 10.20.193.91:0/1895323697 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3c0c0309b0 con 0x7f3c1c1229b0 2026-02-13T02:41:12.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1c163b40 con 0x7f3c1c1229b0 2026-02-13T02:41:12.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c13fff6c0 1 -- 10.20.193.91:0/1895323697 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c0c032920 con 0x7f3c1c1229b0 2026-02-13T02:41:12.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1c163f70 con 0x7f3c1c1229b0 2026-02-13T02:41:12.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.541+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1c110500 con 0x7f3c1c1229b0 2026-02-13T02:41:12.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.542+0000 7f3c13fff6c0 1 -- 10.20.193.91:0/1895323697 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f3c0c032030 con 0x7f3c1c1229b0 2026-02-13T02:41:12.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.543+0000 7f3c13fff6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3be40b56d0 0x7f3be40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:12.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.543+0000 7f3c13fff6c0 1 -- 10.20.193.91:0/1895323697 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5973+0+0 (secure 0 0 0) 0x7f3c0c1087b0 con 0x7f3c1c1229b0 2026-02-13T02:41:12.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.543+0000 7f3c1affd6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3be40b56d0 0x7f3be40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:12.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.544+0000 7f3c13fff6c0 1 -- 10.20.193.91:0/1895323697 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3c0c0cba70 con 0x7f3c1c1229b0 2026-02-13T02:41:12.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.544+0000 7f3c1affd6c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3be40b56d0 0x7f3be40d5b80 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c08004750 tx=0x7f3c08005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:12.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:12.639+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f3c1c10fc20 con 0x7f3be40b56d0 2026-02-13T02:41:13.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='client.24518 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:13.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:13.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:13 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:13.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:13.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:13.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:13.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='client.24518 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:13.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:13 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='client.24518 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:13.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:13 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] boot 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: osdmap e58: 10 total, 10 up, 10 in 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:14.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"} : dispatch 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/3036344195' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"} : dispatch 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"}]': finished 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='client.? 10.20.193.91:0/544482891' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.447 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:14.448 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:14 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:14.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:41:14.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] boot 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: osdmap e58: 10 total, 10 up, 10 in 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"} : dispatch 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/3036344195' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"} : dispatch 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"}]': finished 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:14.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='client.? 10.20.193.91:0/544482891' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:14.479 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:14.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:14.480 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:14 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: osd.9 [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] boot 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: osdmap e58: 10 total, 10 up, 10 in 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:14.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/3036344195' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc"}]': finished 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='client.? 10.20.193.91:0/544482891' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:14.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:14.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:14.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:41:14.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:14.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:14.518 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:14 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:15.489 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:15 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:15.490 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:15 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:41:15.490 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:15 trial091 ceph-mon[27614]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T02:41:15.490 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:15 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:15.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:15 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:15.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:15 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:41:15.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:15 trial154 ceph-mon[27921]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T02:41:15.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:15 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:15.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:15 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:15.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:15 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:41:15.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:15 trial078 ceph-mon[22944]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T02:41:15.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:15 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T02:41:16.311 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:16 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:16.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:16.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T02:41:16.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:16 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T02:41:16.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:16 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:17.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:17 trial154 ceph-mon[27921]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:17.515 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:17 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:17.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:17 trial091 ceph-mon[27614]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:17.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:17 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:17.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:17 trial078 ceph-mon[22944]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:17.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:17 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:18.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:18 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:18.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:18 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:18.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:18 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:18.516 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:18 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:18.517 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:18 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:18.517 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:18 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:18.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:18 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:18.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:18 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:18.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:18 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:19.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.155+0000 7f3c13fff6c0 1 -- 10.20.193.91:0/1895323697 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3c1c10fc20 con 0x7f3be40b56d0 2026-02-13T02:41:19.155 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 10 on host 'trial091' 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3be40b56d0 msgr2=0x7f3be40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3be40b56d0 0x7f3be40d5b80 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c08004750 tx=0x7f3c08005f10 comp rx=0 tx=0).stop 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c1229b0 msgr2=0x7f3c1c122e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c1229b0 0x7f3c1c122e50 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c00a390 tx=0x7f3c0c005530 comp rx=0 tx=0).stop 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 shutdown_connections 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3be40b56d0 0x7f3be40d5b80 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c1c1229b0 0x7f3c1c122e50 unknown :-1 s=CLOSED pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:19.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1c115440 0x7f3c1c11d5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:19.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 --2- 10.20.193.91:0/1895323697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3c1c10f230 0x7f3c1c11d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:19.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 >> 10.20.193.91:0/1895323697 conn(0x7f3c1c0ecb30 msgr2=0x7f3c1c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:19.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 shutdown_connections 2026-02-13T02:41:19.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T02:41:19.157+0000 7f3c212b96c0 1 -- 10.20.193.91:0/1895323697 wait complete. 2026-02-13T02:41:19.200 DEBUG:teuthology.orchestra.run.trial091:osd.10> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.10.service 2026-02-13T02:41:19.243 INFO:tasks.cephadm:Deploying osd.11 on trial154 with /dev/vg_nvme/lv_1... 2026-02-13T02:41:19.244 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T02:41:19.364 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:41:19.804 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:19.804 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:41:19.805 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:19.806 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:19.806 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:19 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:19.818 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T02:41:19.835 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_1 --skip-validation 2026-02-13T02:41:19.953 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:41:20.069 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/1010270069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 msgr2=0x7fb8a810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/1010270069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a810f5d0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=3657919491911248603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8940099a0 tx=0x7fb89402ed20 comp rx=0 tx=0).stop 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/1010270069 shutdown_connections 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/1010270069 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8a8115410 0x7fb8a8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/1010270069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb8a810fbf0 0x7fb8a8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/1010270069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a810f5d0 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=3657919491911248603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/1010270069 >> 10.20.193.154:0/1010270069 conn(0x7fb8a80ecb00 msgr2=0x7fb8a810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/1010270069 shutdown_connections 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/1010270069 wait complete. 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 Processor -- start 2026-02-13T02:41:20.070 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.063+0000 7fb8aed1d6c0 1 -- start start 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a8066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8a8115410 0x7fb8a8062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb8a8062f70 0x7fb8a8063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8167c30 con 0x7fb8a8115410 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8167da0 con 0x7fb8a8062f70 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8167f60 con 0x7fb8a810f200 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a8066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a8066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:60234/0 (socket says 10.20.193.154:60234) 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 -- 10.20.193.154:0/504955293 learned_addr learned my addr 10.20.193.154:0/504955293 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8ad28f6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb8a8062f70 0x7fb8a8063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 -- 10.20.193.154:0/504955293 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb8a8062f70 msgr2=0x7fb8a8063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:20.071 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb8a8062f70 0x7fb8a8063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 -- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8a8115410 msgr2=0x7fb8a8062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8a8115410 0x7fb8a8062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 -- 10.20.193.154:0/504955293 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb894009590 con 0x7fb8a810f200 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aca8e6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a8066730 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb894031fd0 tx=0x7fb8940047f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8a5ffb6c0 1 -- 10.20.193.154:0/504955293 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb894002ae0 con 0x7fb8a810f200 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8a5ffb6c0 1 -- 10.20.193.154:0/504955293 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb894002c40 con 0x7fb8a810f200 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a81681e0 con 0x7fb8a810f200 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8a5ffb6c0 1 -- 10.20.193.154:0/504955293 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8940372f0 con 0x7fb8a810f200 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a8168660 con 0x7fb8a810f200 2026-02-13T02:41:20.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.064+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a81104d0 con 0x7fb8a810f200 2026-02-13T02:41:20.073 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.066+0000 7fb8a5ffb6c0 1 -- 10.20.193.154:0/504955293 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb8940077d0 con 0x7fb8a810f200 2026-02-13T02:41:20.074 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.066+0000 7fb8a5ffb6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb8700b5650 0x7fb8700d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:20.074 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.067+0000 7fb8a5ffb6c0 1 -- 10.20.193.154:0/504955293 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6390+0+0 (secure 0 0 0) 0x7fb894107720 con 0x7fb8a810f200 2026-02-13T02:41:20.074 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.067+0000 7fb8a5ffb6c0 1 -- 10.20.193.154:0/504955293 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb894107c10 con 0x7fb8a810f200 2026-02-13T02:41:20.074 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.067+0000 7fb8a7fff6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb8700b5650 0x7fb8700d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:20.074 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.067+0000 7fb8a7fff6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb8700b5650 0x7fb8700d5b00 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb890005980 tx=0x7fb890005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:20.166 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:20.162+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb8a8063c90 con 0x7fb8700b5650 2026-02-13T02:41:20.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:20.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:41:20.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:19 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:20.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:20.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:19 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:21.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:21.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:21.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T02:41:21.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:21.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:20 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:21.197 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:21.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:21.198 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:20 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.198 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:41:20 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:41:20.770+0000 7f5e792446c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T02:41:21.198 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:41:20 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:41:20.778+0000 7f5e751086c0 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:41:21.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:21.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:21.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T02:41:21.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T02:41:21.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:21.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:20 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:22.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:22.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:22.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/143013728' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"} : dispatch 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"} : dispatch 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"}]': finished 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] boot 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T02:41:22.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:22.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: from='client.? 10.20.193.154:0/4235761158' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:22.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:22.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:21 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:41:22.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:22.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:22.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:41:22.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/143013728' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"} : dispatch 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"} : dispatch 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"}]': finished 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] boot 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: from='client.? 10.20.193.154:0/4235761158' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:21 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:41:22.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:22.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:41:22.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T02:41:22.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T02:41:22.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/143013728' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"} : dispatch 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"} : dispatch 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28724285-e1a8-4a0f-9b85-fc1a478ddc47"}]': finished 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: osd.10 [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] boot 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: from='client.? 10.20.193.154:0/4235761158' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:22.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:21 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:41:23.261 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:41:23.261 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:41:23.261 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:23.262 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:22 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:23.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:41:23.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:41:23.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T02:41:23.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:23.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:22 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:41:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:41:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T02:41:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:23.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:23.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:23.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:23.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:23.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:23.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:22 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:24.080 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:23 trial154 ceph-mon[27921]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.080 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:23 trial154 ceph-mon[27921]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.080 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:23 trial154 ceph-mon[27921]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T02:41:24.080 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:23 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:24.080 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:23 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T02:41:24.080 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:23 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:24.080 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:23 trial154 ceph-mon[27921]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:23 trial091 ceph-mon[27614]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:23 trial091 ceph-mon[27614]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:23 trial091 ceph-mon[27614]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T02:41:24.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:23 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:24.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:23 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T02:41:24.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:23 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:24.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:23 trial091 ceph-mon[27614]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:23 trial078 ceph-mon[22944]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:23 trial078 ceph-mon[22944]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:23 trial078 ceph-mon[22944]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T02:41:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:23 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:23 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T02:41:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:23 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:24.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:23 trial078 ceph-mon[22944]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:25.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:24 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:25.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:24 trial154 ceph-mon[27921]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T02:41:25.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:24 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:25.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:24 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:25.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:24 trial091 ceph-mon[27614]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T02:41:25.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:24 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:25.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:24 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:25.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:24 trial078 ceph-mon[22944]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T02:41:25.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:24 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:26.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:26 trial154 ceph-mon[27921]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T02:41:26.070 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:26.070 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:26.070 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:26.070 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:26 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:26.070 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:26 trial154 ceph-mon[27921]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T02:41:26.339 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:26 trial091 ceph-mon[27614]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T02:41:26.339 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:26.339 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:26.339 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:26.339 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:26 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:26.339 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:26 trial091 ceph-mon[27614]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T02:41:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:26 trial078 ceph-mon[22944]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T02:41:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:26 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:26.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:26 trial078 ceph-mon[22944]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T02:41:26.598 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 11 on host 'trial154' 2026-02-13T02:41:26.598 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.594+0000 7fb8a5ffb6c0 1 -- 10.20.193.154:0/504955293 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb8a8063c90 con 0x7fb8700b5650 2026-02-13T02:41:26.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb8700b5650 msgr2=0x7fb8700d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:26.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb8700b5650 0x7fb8700d5b00 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb890005980 tx=0x7fb890005910 comp rx=0 tx=0).stop 2026-02-13T02:41:26.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 msgr2=0x7fb8a8066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:26.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a8066730 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb894031fd0 tx=0x7fb8940047f0 comp rx=0 tx=0).stop 2026-02-13T02:41:26.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 shutdown_connections 2026-02-13T02:41:26.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb8700b5650 0x7fb8700d5b00 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:26.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb8a8062f70 0x7fb8a8063410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:26.602 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8a8115410 0x7fb8a8062990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:26.602 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 --2- 10.20.193.154:0/504955293 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb8a810f200 0x7fb8a8066730 unknown :-1 s=CLOSED pgs=68 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:26.602 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 >> 10.20.193.154:0/504955293 conn(0x7fb8a80ecb00 msgr2=0x7fb8a810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:26.602 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 shutdown_connections 2026-02-13T02:41:26.602 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:26.596+0000 7fb8aed1d6c0 1 -- 10.20.193.154:0/504955293 wait complete. 2026-02-13T02:41:26.640 DEBUG:teuthology.orchestra.run.trial154:osd.11> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.11.service 2026-02-13T02:41:26.643 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T02:41:26.643 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T02:41:26.831 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:27.031 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.029+0000 7f5dc65846c0 1 -- 10.20.193.78:0/1829086954 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc010ba90 msgr2=0x7f5dc010be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.029+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/1829086954 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc010ba90 0x7f5dc010be60 secure :-1 s=READY pgs=134 gs=3 cs=0 l=1 c_cookie=3003365532832631025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dac009970 tx=0x7f5dac02ed10 comp rx=0 tx=0).stop 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.029+0000 7f5dc65846c0 1 -- 10.20.193.78:0/1829086954 shutdown_connections 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.029+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/1829086954 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5dc01110a0 0x7f5dc0111520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.029+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/1829086954 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 0x7f5dc0110a50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.029+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/1829086954 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc010ba90 0x7f5dc010be60 unknown :-1 s=CLOSED pgs=134 gs=3 cs=0 l=1 c_cookie=3003365532832631025 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.029+0000 7f5dc65846c0 1 -- 10.20.193.78:0/1829086954 >> 10.20.193.78:0/1829086954 conn(0x7f5dc00e9700 msgr2=0x7f5dc0109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.030+0000 7f5dc65846c0 1 -- 10.20.193.78:0/1829086954 shutdown_connections 2026-02-13T02:41:27.032 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.030+0000 7f5dc65846c0 1 -- 10.20.193.78:0/1829086954 wait complete. 2026-02-13T02:41:27.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.030+0000 7f5dc65846c0 1 Processor -- start 2026-02-13T02:41:27.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.030+0000 7f5dc65846c0 1 -- start start 2026-02-13T02:41:27.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc65846c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5dc010ba90 0x7f5dc01219c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc65846c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 0x7f5dc0121f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc65846c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc01110a0 0x7f5dc01272c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 0x7f5dc0121f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 0x7f5dc0121f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:43130/0 (socket says 10.20.193.78:43130) 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5dc010ba90 0x7f5dc01219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5dc010ba90 0x7f5dc01219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:57266/0 (socket says 10.20.193.78:57266) 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 -- 10.20.193.78:0/4054971785 learned_addr learned my addr 10.20.193.78:0/4054971785 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc0127910 con 0x7f5dc01110a0 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc0127a80 con 0x7f5dc010c480 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc0127c40 con 0x7f5dc010ba90 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc4af66c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc01110a0 0x7f5dc01272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:27.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 -- 10.20.193.78:0/4054971785 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5dc010ba90 msgr2=0x7f5dc01219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5dc010ba90 0x7f5dc01219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 -- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc01110a0 msgr2=0x7f5dc01272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc01110a0 0x7f5dc01272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac009590 con 0x7f5dc010c480 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbf7fe6c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 0x7f5dc0121f00 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5db0009490 tx=0x7f5db000bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dbd7fa6c0 1 -- 10.20.193.78:0/4054971785 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5db0004a80 con 0x7f5dc010c480 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.031+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc0127f20 con 0x7f5dc010c480 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.032+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc0168600 con 0x7f5dc010c480 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.032+0000 7f5dbd7fa6c0 1 -- 10.20.193.78:0/4054971785 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5db0009030 con 0x7f5dc010c480 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.032+0000 7f5dbd7fa6c0 1 -- 10.20.193.78:0/4054971785 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5db00071c0 con 0x7f5dc010c480 2026-02-13T02:41:27.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.032+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc005fb90 con 0x7f5dc010c480 2026-02-13T02:41:27.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.034+0000 7f5dbd7fa6c0 1 -- 10.20.193.78:0/4054971785 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f5db0004060 con 0x7f5dc010c480 2026-02-13T02:41:27.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.036+0000 7f5dbd7fa6c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5d940b56d0 0x7f5d940d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:27.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.036+0000 7f5dbd7fa6c0 1 -- 10.20.193.78:0/4054971785 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6801+0+0 (secure 0 0 0) 0x7f5db00e35e0 con 0x7f5dc010c480 2026-02-13T02:41:27.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.036+0000 7f5dbd7fa6c0 1 -- 10.20.193.78:0/4054971785 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5db00e3a60 con 0x7f5dc010c480 2026-02-13T02:41:27.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.036+0000 7f5dbffff6c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5d940b56d0 0x7f5d940d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:27.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.036+0000 7f5dbffff6c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5d940b56d0 0x7f5d940d5b80 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dac0098c0 tx=0x7f5dac0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.138+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5dc0122b40 con 0x7f5dc010c480 2026-02-13T02:41:27.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.138+0000 7f5dbd7fa6c0 1 -- 10.20.193.78:0/4054971785 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f5db00a6520 con 0x7f5dc010c480 2026-02-13T02:41:27.140 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.139+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5d940b56d0 msgr2=0x7f5d940d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:27.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.139+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5d940b56d0 0x7f5d940d5b80 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dac0098c0 tx=0x7f5dac0023a0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.139+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 msgr2=0x7f5dc0121f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.139+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 0x7f5dc0121f00 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5db0009490 tx=0x7f5db000bca0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 shutdown_connections 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5d940b56d0 0x7f5d940d5b80 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dc01110a0 0x7f5dc01272c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5dc010c480 0x7f5dc0121f00 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 --2- 10.20.193.78:0/4054971785 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5dc010ba90 0x7f5dc01219c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 >> 10.20.193.78:0/4054971785 conn(0x7f5dc00e9700 msgr2=0x7f5dc0109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 shutdown_connections 2026-02-13T02:41:27.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:27.140+0000 7f5dc65846c0 1 -- 10.20.193.78:0/4054971785 wait complete. 2026-02-13T02:41:27.245 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1770950480,"num_in_osds":12,"osd_in_since":1770950480,"num_remapped_pgs":0} 2026-02-13T02:41:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:27.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 177 KiB/s, 0 objects/s recovering 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:27.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:27 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4054971785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:27.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:27.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:27.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 177 KiB/s, 0 objects/s recovering 2026-02-13T02:41:27.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:27.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:27 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4054971785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:27.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:27.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:27.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 177 KiB/s, 0 objects/s recovering 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:27.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:27 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4054971785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:28.246 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T02:41:28.303 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T02:41:28.303 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:28.303 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T02:41:28.303 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T02:41:28.303 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:28.303 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:28.303 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:41:28.304 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:28.305 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:28.305 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:28 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:28.305 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:41:28 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:41:28.233+0000 7f1344b7f6c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T02:41:28.305 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:41:28 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:41:28.240+0000 7f133ca3b6c0 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:41:28.432 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:28.499 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:28.500 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:28 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:28.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.628+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/1896935618 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c116520 msgr2=0x7fdb4c17a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.628+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/1896935618 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c116520 0x7fdb4c17a100 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=15360423362205807087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb4800aa70 tx=0x7fdb4802fde0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/1896935618 shutdown_connections 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/1896935618 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c116520 0x7fdb4c17a100 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=15360423362205807087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/1896935618 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb4c114190 0x7fdb4c115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/1896935618 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb4c1137a0 0x7fdb4c113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/1896935618 >> 10.20.193.78:0/1896935618 conn(0x7fdb4c061510 msgr2=0x7fdb4c061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/1896935618 shutdown_connections 2026-02-13T02:41:28.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/1896935618 wait complete. 2026-02-13T02:41:28.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 Processor -- start 2026-02-13T02:41:28.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.629+0000 7fdb52c5b6c0 1 -- start start 2026-02-13T02:41:28.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb52c5b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c1137a0 0x7fdb4c1214b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:28.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb52c5b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb4c116520 0x7fdb4c1219f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:28.633 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb52c5b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb4c126db0 0x7fdb4c127250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb52c5b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c1277c0 con 0x7fdb4c1137a0 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb52c5b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c127930 con 0x7fdb4c126db0 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb52c5b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c127af0 con 0x7fdb4c116520 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c1137a0 0x7fdb4c1214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c1137a0 0x7fdb4c1214b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46886/0 (socket says 10.20.193.78:46886) 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 -- 10.20.193.78:0/2767016666 learned_addr learned my addr 10.20.193.78:0/2767016666 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb514586c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb4c116520 0x7fdb4c1219f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb5245a6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb4c126db0 0x7fdb4c127250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 -- 10.20.193.78:0/2767016666 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb4c116520 msgr2=0x7fdb4c1219f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb4c116520 0x7fdb4c1219f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 -- 10.20.193.78:0/2767016666 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb4c126db0 msgr2=0x7fdb4c127250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb4c126db0 0x7fdb4c127250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.630+0000 7fdb51c596c0 1 -- 10.20.193.78:0/2767016666 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4800a660 con 0x7fdb4c1137a0 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.631+0000 7fdb51c596c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c1137a0 0x7fdb4c1214b0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb3c00b710 tx=0x7fdb3c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.631+0000 7fdb3affd6c0 1 -- 10.20.193.78:0/2767016666 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb3c004250 con 0x7fdb4c1137a0 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.631+0000 7fdb3affd6c0 1 -- 10.20.193.78:0/2767016666 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb3c009070 con 0x7fdb4c1137a0 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.631+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4c167fa0 con 0x7fdb4c1137a0 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.631+0000 7fdb3affd6c0 1 -- 10.20.193.78:0/2767016666 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb3c00cd70 con 0x7fdb4c1137a0 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.631+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4c168480 con 0x7fdb4c1137a0 2026-02-13T02:41:28.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.632+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb4c114840 con 0x7fdb4c1137a0 2026-02-13T02:41:28.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.634+0000 7fdb3affd6c0 1 -- 10.20.193.78:0/2767016666 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fdb3c0028c0 con 0x7fdb4c1137a0 2026-02-13T02:41:28.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.635+0000 7fdb3affd6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb280b56d0 0x7fdb280d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:28.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.635+0000 7fdb3affd6c0 1 -- 10.20.193.78:0/2767016666 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6839+0+0 (secure 0 0 0) 0x7fdb3c0e35a0 con 0x7fdb4c1137a0 2026-02-13T02:41:28.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.636+0000 7fdb3affd6c0 1 -- 10.20.193.78:0/2767016666 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb3c0e3a20 con 0x7fdb4c1137a0 2026-02-13T02:41:28.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.636+0000 7fdb514586c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb280b56d0 0x7fdb280d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:28.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.636+0000 7fdb514586c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb280b56d0 0x7fdb280d5b80 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb4c127e40 tx=0x7fdb40009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:28.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T02:41:28.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:28.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T02:41:28.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T02:41:28.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:28.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:28.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:41:28.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:28.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:28.697 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:28 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:28.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.736+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdb4c113b70 con 0x7fdb4c1137a0 2026-02-13T02:41:28.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.736+0000 7fdb3affd6c0 1 -- 10.20.193.78:0/2767016666 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7fdb3c0a64c0 con 0x7fdb4c1137a0 2026-02-13T02:41:28.738 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:28.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.737+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb280b56d0 msgr2=0x7fdb280d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:28.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.737+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb280b56d0 0x7fdb280d5b80 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb4c127e40 tx=0x7fdb40009260 comp rx=0 tx=0).stop 2026-02-13T02:41:28.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.737+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c1137a0 msgr2=0x7fdb4c1214b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:28.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.737+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c1137a0 0x7fdb4c1214b0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb3c00b710 tx=0x7fdb3c00bbe0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 shutdown_connections 2026-02-13T02:41:28.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb280b56d0 0x7fdb280d5b80 unknown :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb4c126db0 0x7fdb4c127250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb4c116520 0x7fdb4c1219f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 --2- 10.20.193.78:0/2767016666 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb4c1137a0 0x7fdb4c1214b0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:28.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 >> 10.20.193.78:0/2767016666 conn(0x7fdb4c061510 msgr2=0x7fdb4c116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:28.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 shutdown_connections 2026-02-13T02:41:28.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:28.738+0000 7fdb52c5b6c0 1 -- 10.20.193.78:0/2767016666 wait complete. 2026-02-13T02:41:28.844 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1770950480,"num_in_osds":12,"osd_in_since":1770950480,"num_remapped_pgs":0} 2026-02-13T02:41:29.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:29 trial154 ceph-mon[27921]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:41:29.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:29 trial154 ceph-mon[27921]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T02:41:29.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:29.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:29 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:29.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:29 trial154 ceph-mon[27921]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:29.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:29 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2767016666' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:29.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:29 trial091 ceph-mon[27614]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:41:29.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:29 trial091 ceph-mon[27614]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T02:41:29.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:29.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:29 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:29.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:29 trial091 ceph-mon[27614]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:29.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:29 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2767016666' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:29.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:29 trial078 ceph-mon[22944]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T02:41:29.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:29 trial078 ceph-mon[22944]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T02:41:29.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:29.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:29 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:29.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:29 trial078 ceph-mon[22944]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:41:29.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:29 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2767016666' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:29.846 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T02:41:30.030 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:30.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 -- 10.20.193.78:0/92802702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 msgr2=0x7f400c17a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/92802702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 0x7f400c17a100 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=12324000324097896096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ffc00aa40 tx=0x7f3ffc02fde0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 -- 10.20.193.78:0/92802702 shutdown_connections 2026-02-13T02:41:30.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/92802702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 0x7f400c17a100 unknown :-1 s=CLOSED pgs=77 gs=1 cs=0 l=1 c_cookie=12324000324097896096 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/92802702 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f400c113f90 0x7f400c118f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/92802702 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f400c1135a0 0x7f400c113970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 -- 10.20.193.78:0/92802702 >> 10.20.193.78:0/92802702 conn(0x7f400c061dc0 msgr2=0x7f400c0621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:30.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 -- 10.20.193.78:0/92802702 shutdown_connections 2026-02-13T02:41:30.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.222+0000 7f400bfff6c0 1 -- 10.20.193.78:0/92802702 wait complete. 2026-02-13T02:41:30.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.223+0000 7f400bfff6c0 1 Processor -- start 2026-02-13T02:41:30.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.223+0000 7f400bfff6c0 1 -- start start 2026-02-13T02:41:30.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f400c1135a0 0x7f400c1213e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 0x7f400c121920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f400c126ce0 0x7f400c127180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400bfff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f400c1276f0 con 0x7f400c1135a0 2026-02-13T02:41:30.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400bfff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f400c127860 con 0x7f400c119760 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400bfff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f400c127a20 con 0x7f400c126ce0 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400a7fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 0x7f400c121920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400affd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f400c1135a0 0x7f400c1213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f400c126ce0 0x7f400c127180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f400c126ce0 0x7f400c127180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:57302/0 (socket says 10.20.193.78:57302) 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400b7fe6c0 1 -- 10.20.193.78:0/4223681891 learned_addr learned my addr 10.20.193.78:0/4223681891 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400affd6c0 1 -- 10.20.193.78:0/4223681891 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f400c126ce0 msgr2=0x7f400c127180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400affd6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f400c126ce0 0x7f400c127180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400affd6c0 1 -- 10.20.193.78:0/4223681891 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 msgr2=0x7f400c121920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400affd6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 0x7f400c121920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400affd6c0 1 -- 10.20.193.78:0/4223681891 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff40094c0 con 0x7f400c1135a0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.224+0000 7f400affd6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f400c1135a0 0x7f400c1213e0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f400000b6c0 tx=0x7f400000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.225+0000 7f401092e6c0 1 -- 10.20.193.78:0/4223681891 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4000004240 con 0x7f400c1135a0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.225+0000 7f401092e6c0 1 -- 10.20.193.78:0/4223681891 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4000009030 con 0x7f400c1135a0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.225+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc00a660 con 0x7f400c1135a0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.225+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400c1681d0 con 0x7f400c1135a0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.225+0000 7f401092e6c0 1 -- 10.20.193.78:0/4223681891 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40000036e0 con 0x7f400c1135a0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.225+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400c114820 con 0x7f400c1135a0 2026-02-13T02:41:30.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.228+0000 7f401092e6c0 1 -- 10.20.193.78:0/4223681891 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f40000038a0 con 0x7f400c1135a0 2026-02-13T02:41:30.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.229+0000 7f401092e6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3fe00b5650 0x7f3fe00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.229+0000 7f401092e6c0 1 -- 10.20.193.78:0/4223681891 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f40000e3600 con 0x7f400c1135a0 2026-02-13T02:41:30.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.229+0000 7f400a7fc6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3fe00b5650 0x7f3fe00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.229+0000 7f401092e6c0 1 -- 10.20.193.78:0/4223681891 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f40000e3a80 con 0x7f400c1135a0 2026-02-13T02:41:30.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.230+0000 7f400a7fc6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3fe00b5650 0x7f3fe00d5b00 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f400c127d70 tx=0x7f3ff4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:30.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.329+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f400c122590 con 0x7f400c1135a0 2026-02-13T02:41:30.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.330+0000 7f401092e6c0 1 -- 10.20.193.78:0/4223681891 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f40000a6410 con 0x7f400c1135a0 2026-02-13T02:41:30.332 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3fe00b5650 msgr2=0x7f3fe00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3fe00b5650 0x7f3fe00d5b00 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f400c127d70 tx=0x7f3ff4009260 comp rx=0 tx=0).stop 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f400c1135a0 msgr2=0x7f400c1213e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f400c1135a0 0x7f400c1213e0 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f400000b6c0 tx=0x7f400000bb90 comp rx=0 tx=0).stop 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 shutdown_connections 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3fe00b5650 0x7f3fe00d5b00 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f400c126ce0 0x7f400c127180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f400c119760 0x7f400c121920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 --2- 10.20.193.78:0/4223681891 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f400c1135a0 0x7f400c1213e0 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 >> 10.20.193.78:0/4223681891 conn(0x7f400c061dc0 msgr2=0x7f400c1165f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:30.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 shutdown_connections 2026-02-13T02:41:30.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.331+0000 7f400bfff6c0 1 -- 10.20.193.78:0/4223681891 wait complete. 2026-02-13T02:41:30.409 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:30 trial078 ceph-mon[22944]: purged_snaps scrub starts 2026-02-13T02:41:30.409 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:30 trial078 ceph-mon[22944]: purged_snaps scrub ok 2026-02-13T02:41:30.409 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:30 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:30.410 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:30 trial078 ceph-mon[22944]: osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] boot 2026-02-13T02:41:30.410 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:30 trial078 ceph-mon[22944]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T02:41:30.410 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:30 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:30.434 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1770950489,"num_in_osds":12,"osd_in_since":1770950480,"num_remapped_pgs":0} 2026-02-13T02:41:30.435 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:41:30.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:30 trial154 ceph-mon[27921]: purged_snaps scrub starts 2026-02-13T02:41:30.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:30 trial154 ceph-mon[27921]: purged_snaps scrub ok 2026-02-13T02:41:30.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:30 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:30.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:30 trial154 ceph-mon[27921]: osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] boot 2026-02-13T02:41:30.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:30 trial154 ceph-mon[27921]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T02:41:30.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:30 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:30.617 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:30.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:30 trial091 ceph-mon[27614]: purged_snaps scrub starts 2026-02-13T02:41:30.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:30 trial091 ceph-mon[27614]: purged_snaps scrub ok 2026-02-13T02:41:30.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:30 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:30.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:30 trial091 ceph-mon[27614]: osd.11 [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] boot 2026-02-13T02:41:30.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:30 trial091 ceph-mon[27614]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T02:41:30.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:30 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:41:30.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 -- 10.20.193.78:0/3905288264 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 msgr2=0x7f092c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/3905288264 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 0x7f092c10f430 secure :-1 s=READY pgs=78 gs=1 cs=0 l=1 c_cookie=5824882254166918561 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0918009970 tx=0x7f091802ed10 comp rx=0 tx=0).stop 2026-02-13T02:41:30.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 -- 10.20.193.78:0/3905288264 shutdown_connections 2026-02-13T02:41:30.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/3905288264 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c115270 0x7f092c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/3905288264 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f092c10fa50 0x7f092c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/3905288264 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 0x7f092c10f430 unknown :-1 s=CLOSED pgs=78 gs=1 cs=0 l=1 c_cookie=5824882254166918561 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 -- 10.20.193.78:0/3905288264 >> 10.20.193.78:0/3905288264 conn(0x7f092c0ec980 msgr2=0x7f092c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:30.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 -- 10.20.193.78:0/3905288264 shutdown_connections 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.811+0000 7f0930acb6c0 1 -- 10.20.193.78:0/3905288264 wait complete. 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 Processor -- start 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 -- start start 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 0x7f092c11d030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f092c115270 0x7f092c11d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c122930 0x7f092c122dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f092c123340 con 0x7f092c122930 2026-02-13T02:41:30.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f092c1234b0 con 0x7f092c10f060 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.812+0000 7f0930acb6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f092c123670 con 0x7f092c115270 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092affd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f092c115270 0x7f092c11d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c122930 0x7f092c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 0x7f092c11d030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c122930 0x7f092c122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46918/0 (socket says 10.20.193.78:46918) 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092affd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f092c115270 0x7f092c11d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:57318/0 (socket says 10.20.193.78:57318) 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 -- 10.20.193.78:0/1540574746 learned_addr learned my addr 10.20.193.78:0/1540574746 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 -- 10.20.193.78:0/1540574746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f092c115270 msgr2=0x7f092c11d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.818 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f092c115270 0x7f092c11d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 -- 10.20.193.78:0/1540574746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 msgr2=0x7f092c11d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 0x7f092c11d030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 -- 10.20.193.78:0/1540574746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092000a5b0 con 0x7f092c122930 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f092bfff6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c122930 0x7f092c122dd0 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f092000a820 tx=0x7f092000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f0928ff96c0 1 -- 10.20.193.78:0/1540574746 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0920003c40 con 0x7f092c122930 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f0928ff96c0 1 -- 10.20.193.78:0/1540574746 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f092000a070 con 0x7f092c122930 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f0928ff96c0 1 -- 10.20.193.78:0/1540574746 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0920008440 con 0x7f092c122930 2026-02-13T02:41:30.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0918009590 con 0x7f092c122930 2026-02-13T02:41:30.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.813+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092c163e20 con 0x7f092c122930 2026-02-13T02:41:30.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.814+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092c110330 con 0x7f092c122930 2026-02-13T02:41:30.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.816+0000 7f0928ff96c0 1 -- 10.20.193.78:0/1540574746 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0920005030 con 0x7f092c122930 2026-02-13T02:41:30.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.818+0000 7f0928ff96c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09000b57a0 0x7f09000d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:30.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.818+0000 7f0928ff96c0 1 -- 10.20.193.78:0/1540574746 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f09200e4740 con 0x7f092c122930 2026-02-13T02:41:30.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.818+0000 7f0928ff96c0 1 -- 10.20.193.78:0/1540574746 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f09200e4bc0 con 0x7f092c122930 2026-02-13T02:41:30.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.818+0000 7f092b7fe6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09000b57a0 0x7f09000d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:30.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.819+0000 7f092b7fe6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09000b57a0 0x7f09000d5c50 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0918031fd0 tx=0x7f09180023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:30.922 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.920+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f092c10f430 con 0x7f092c122930 2026-02-13T02:41:30.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.921+0000 7f0928ff96c0 1 -- 10.20.193.78:0/1540574746 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18455 (secure 0 0 0) 0x7f09200a7550 con 0x7f092c122930 2026-02-13T02:41:30.923 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:30.924 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":71,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","created":"2026-02-13T02:38:52.551926+0000","modified":"2026-02-13T02:41:30.241279+0000","last_up_change":"2026-02-13T02:41:29.235143+0000","last_in_change":"2026-02-13T02:41:20.987708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:40:11.017308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4e99f87-c52f-4ab4-9ef0-2fc796b8084f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6803","nonce":2712462435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6805","nonce":2712462435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6809","nonce":2712462435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6807","nonce":2712462435}]},"public_addr":"10.20.193.78:6803/2712462435","cluster_addr":"10.20.193.78:6805/2712462435","heartbeat_back_addr":"10.20.193.78:6809/2712462435","heartbeat_front_addr":"10.20.193.78:6807/2712462435","state":["exists","up"]},{"osd":1,"uuid":"75b41a4c-dddc-4c29-885c-997d3f7212c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6800","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6801","nonce":196768757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6803","nonce":196768757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6807","nonce":196768757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6805","nonce":196768757}]},"public_addr":"10.20.193.91:6801/196768757","cluster_addr":"10.20.193.91:6803/196768757","heartbeat_back_addr":"10.20.193.91:6807/196768757","heartbeat_front_addr":"10.20.193.91:6805/196768757","state":["exists","up"]},{"osd":2,"uuid":"2697034a-905b-4bdb-adb4-4f945060e9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6801","nonce":2640210611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6803","nonce":2640210611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6807","nonce":2640210611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6805","nonce":2640210611}]},"public_addr":"10.20.193.154:6801/2640210611","cluster_addr":"10.20.193.154:6803/2640210611","heartbeat_back_addr":"10.20.193.154:6807/2640210611","heartbeat_front_addr":"10.20.193.154:6805/2640210611","state":["exists","up"]},{"osd":3,"uuid":"520c54bf-23d1-4eee-9bb8-a89711e96784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6811","nonce":71468509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6813","nonce":71468509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6817","nonce":71468509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6815","nonce":71468509}]},"public_addr":"10.20.193.78:6811/71468509","cluster_addr":"10.20.193.78:6813/71468509","heartbeat_back_addr":"10.20.193.78:6817/71468509","heartbeat_front_addr":"10.20.193.78:6815/71468509","state":["exists","up"]},{"osd":4,"uuid":"a4c56acb-cf6d-4fb7-a682-d848d6b2651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6809","nonce":4184387195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6811","nonce":4184387195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6815","nonce":4184387195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6813","nonce":4184387195}]},"public_addr":"10.20.193.91:6809/4184387195","cluster_addr":"10.20.193.91:6811/4184387195","heartbeat_back_addr":"10.20.193.91:6815/4184387195","heartbeat_front_addr":"10.20.193.91:6813/4184387195","state":["exists","up"]},{"osd":5,"uuid":"1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6809","nonce":1052719265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6811","nonce":1052719265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6815","nonce":1052719265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6813","nonce":1052719265}]},"public_addr":"10.20.193.154:6809/1052719265","cluster_addr":"10.20.193.154:6811/1052719265","heartbeat_back_addr":"10.20.193.154:6815/1052719265","heartbeat_front_addr":"10.20.193.154:6813/1052719265","state":["exists","up"]},{"osd":6,"uuid":"0cdd77aa-b764-4477-b092-4863371bead5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6819","nonce":1255269393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6821","nonce":1255269393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6825","nonce":1255269393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6823","nonce":1255269393}]},"public_addr":"10.20.193.78:6819/1255269393","cluster_addr":"10.20.193.78:6821/1255269393","heartbeat_back_addr":"10.20.193.78:6825/1255269393","heartbeat_front_addr":"10.20.193.78:6823/1255269393","state":["exists","up"]},{"osd":7,"uuid":"b26572df-8730-4245-996e-9f6ad280cd39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6817","nonce":3280635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6819","nonce":3280635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6823","nonce":3280635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6821","nonce":3280635476}]},"public_addr":"10.20.193.91:6817/3280635476","cluster_addr":"10.20.193.91:6819/3280635476","heartbeat_back_addr":"10.20.193.91:6823/3280635476","heartbeat_front_addr":"10.20.193.91:6821/3280635476","state":["exists","up"]},{"osd":8,"uuid":"87ca52a3-dbf2-4405-b992-876c1a7287a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6817","nonce":1767687637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6819","nonce":1767687637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6823","nonce":1767687637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6821","nonce":1767687637}]},"public_addr":"10.20.193.154:6817/1767687637","cluster_addr":"10.20.193.154:6819/1767687637","heartbeat_back_addr":"10.20.193.154:6823/1767687637","heartbeat_front_addr":"10.20.193.154:6821/1767687637","state":["exists","up"]},{"osd":9,"uuid":"771bc3b1-5e53-408b-a87c-9e9a2174df76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6827","nonce":4211100741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6829","nonce":4211100741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6833","nonce":4211100741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6831","nonce":4211100741}]},"public_addr":"10.20.193.78:6827/4211100741","cluster_addr":"10.20.193.78:6829/4211100741","heartbeat_back_addr":"10.20.193.78:6833/4211100741","heartbeat_front_addr":"10.20.193.78:6831/4211100741","state":["exists","up"]},{"osd":10,"uuid":"34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6825","nonce":1302687241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6827","nonce":1302687241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6831","nonce":1302687241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6829","nonce":1302687241}]},"public_addr":"10.20.193.91:6825/1302687241","cluster_addr":"10.20.193.91:6827/1302687241","heartbeat_back_addr":"10.20.193.91:6831/1302687241","heartbeat_front_addr":"10.20.193.91:6829/1302687241","state":["exists","up"]},{"osd":11,"uuid":"28724285-e1a8-4a0f-9b85-fc1a478ddc47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6825","nonce":1149779767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6827","nonce":1149779767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6831","nonce":1149779767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6829","nonce":1149779767}]},"public_addr":"10.20.193.154:6825/1149779767","cluster_addr":"10.20.193.154:6827/1149779767","heartbeat_back_addr":"10.20.193.154:6831/1149779767","heartbeat_front_addr":"10.20.193.154:6829/1149779767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:39:54.522850+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:02.051630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:08.940267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:20.309397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:27.909293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:35.059447+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:46.172446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:53.926260+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:01.093058+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:12.051230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:20.096746+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:27.469090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.78:6801/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6800/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/97242544":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/1589977769":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/3668729280":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/2986039701":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/1592616596":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6801/3975596185":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/2877801719":"2026-02-14T02:39:00.593239+0000","10.20.193.78:6800/3975596185":"2026-02-14T02:39:00.593239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:41:30.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09000b57a0 msgr2=0x7f09000d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09000b57a0 0x7f09000d5c50 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0918031fd0 tx=0x7f09180023a0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c122930 msgr2=0x7f092c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:30.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c122930 0x7f092c122dd0 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f092000a820 tx=0x7f092000ce50 comp rx=0 tx=0).stop 2026-02-13T02:41:30.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 shutdown_connections 2026-02-13T02:41:30.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09000b57a0 0x7f09000d5c50 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f092c122930 0x7f092c122dd0 unknown :-1 s=CLOSED pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f092c115270 0x7f092c11d570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 --2- 10.20.193.78:0/1540574746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f092c10f060 0x7f092c11d030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:30.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 >> 10.20.193.78:0/1540574746 conn(0x7f092c0ec980 msgr2=0x7f092c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:30.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 shutdown_connections 2026-02-13T02:41:30.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:30.922+0000 7f0930acb6c0 1 -- 10.20.193.78:0/1540574746 wait complete. 2026-02-13T02:41:31.027 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T02:40:11.017308+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T02:41:31.028 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T02:41:31.216 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:31.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/2141194726 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a011b3f0 msgr2=0x7fe7a011b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/2141194726 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a011b3f0 0x7fe7a011b7c0 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=1970400662790255130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe794009970 tx=0x7fe79402ed10 comp rx=0 tx=0).stop 2026-02-13T02:41:31.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/2141194726 shutdown_connections 2026-02-13T02:41:31.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/2141194726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe7a01199a0 0x7fe7a0116df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/2141194726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe7a0118f30 0x7fe7a0119380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/2141194726 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a011b3f0 0x7fe7a011b7c0 unknown :-1 s=CLOSED pgs=139 gs=1 cs=0 l=1 c_cookie=1970400662790255130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/2141194726 >> 10.20.193.78:0/2141194726 conn(0x7fe7a005b290 msgr2=0x7fe7a005b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:31.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/2141194726 shutdown_connections 2026-02-13T02:41:31.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.408+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/2141194726 wait complete. 2026-02-13T02:41:31.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 Processor -- start 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 -- start start 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a0118f30 0x7fe7a00fdcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe7a01199a0 0x7fe7a00fe230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe7a011b3f0 0x7fe7a01035f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0103c40 con 0x7fe7a0118f30 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0103db0 con 0x7fe7a01199a0 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79ffff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a0103f70 con 0x7fe7a011b3f0 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79effd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a0118f30 0x7fe7a00fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79effd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a0118f30 0x7fe7a00fdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46930/0 (socket says 10.20.193.78:46930) 2026-02-13T02:41:31.413 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79effd6c0 1 -- 10.20.193.78:0/436274107 learned_addr learned my addr 10.20.193.78:0/436274107 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79e7fc6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe7a01199a0 0x7fe7a00fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.409+0000 7fe79f7fe6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe7a011b3f0 0x7fe7a01035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79effd6c0 1 -- 10.20.193.78:0/436274107 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe7a011b3f0 msgr2=0x7fe7a01035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79effd6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe7a011b3f0 0x7fe7a01035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79effd6c0 1 -- 10.20.193.78:0/436274107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe7a01199a0 msgr2=0x7fe7a00fe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79effd6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe7a01199a0 0x7fe7a00fe230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79effd6c0 1 -- 10.20.193.78:0/436274107 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe794009590 con 0x7fe7a0118f30 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79e7fc6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe7a01199a0 0x7fe7a00fe230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79effd6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a0118f30 0x7fe7a00fdcf0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe794031fd0 tx=0x7fe79402fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe7a48a66c0 1 -- 10.20.193.78:0/436274107 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe794002ae0 con 0x7fe7a0118f30 2026-02-13T02:41:31.414 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe7a48a66c0 1 -- 10.20.193.78:0/436274107 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe794002c40 con 0x7fe7a0118f30 2026-02-13T02:41:31.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe7a48a66c0 1 -- 10.20.193.78:0/436274107 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7940312b0 con 0x7fe7a0118f30 2026-02-13T02:41:31.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a01041f0 con 0x7fe7a0118f30 2026-02-13T02:41:31.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.410+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a0104470 con 0x7fe7a0118f30 2026-02-13T02:41:31.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.411+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a005e670 con 0x7fe7a0118f30 2026-02-13T02:41:31.415 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.413+0000 7fe7a48a66c0 1 -- 10.20.193.78:0/436274107 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fe7940077d0 con 0x7fe7a0118f30 2026-02-13T02:41:31.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.414+0000 7fe7a48a66c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe7740b56d0 0x7fe7740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.414+0000 7fe7a48a66c0 1 -- 10.20.193.78:0/436274107 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fe794107990 con 0x7fe7a0118f30 2026-02-13T02:41:31.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.414+0000 7fe7a48a66c0 1 -- 10.20.193.78:0/436274107 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe794107e10 con 0x7fe7a0118f30 2026-02-13T02:41:31.416 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.414+0000 7fe79e7fc6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe7740b56d0 0x7fe7740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.417 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.415+0000 7fe79e7fc6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe7740b56d0 0x7fe7740d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7a0104680 tx=0x7fe788009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:31.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:31 trial154 ceph-mon[27921]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T02:41:31.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:31 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4223681891' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:31.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:31 trial154 ceph-mon[27921]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:31.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:31 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1540574746' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:31.517 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.515+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe7a0185f20 con 0x7fe7a0118f30 2026-02-13T02:41:31.517 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:31 trial078 ceph-mon[22944]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T02:41:31.517 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:31 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4223681891' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:31.518 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:31 trial078 ceph-mon[22944]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:31.518 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:31 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1540574746' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:31.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.516+0000 7fe7a48a66c0 1 -- 10.20.193.78:0/436274107 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7fe7940ca7a0 con 0x7fe7a0118f30 2026-02-13T02:41:31.518 INFO:teuthology.orchestra.run.trial078.stdout:pg_num: 1 2026-02-13T02:41:31.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe7740b56d0 msgr2=0x7fe7740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe7740b56d0 0x7fe7740d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7a0104680 tx=0x7fe788009260 comp rx=0 tx=0).stop 2026-02-13T02:41:31.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a0118f30 msgr2=0x7fe7a00fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a0118f30 0x7fe7a00fdcf0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe794031fd0 tx=0x7fe79402fc70 comp rx=0 tx=0).stop 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 shutdown_connections 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe7740b56d0 0x7fe7740d5b80 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe7a011b3f0 0x7fe7a01035f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe7a01199a0 0x7fe7a00fe230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 --2- 10.20.193.78:0/436274107 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe7a0118f30 0x7fe7a00fdcf0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 >> 10.20.193.78:0/436274107 conn(0x7fe7a005b290 msgr2=0x7fe7a00f4430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 shutdown_connections 2026-02-13T02:41:31.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:31.517+0000 7fe79ffff6c0 1 -- 10.20.193.78:0/436274107 wait complete. 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.a on trial078 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.d on trial078 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.g on trial078 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.j on trial078 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.b on trial091 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.e on trial091 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.h on trial091 2026-02-13T02:41:31.623 INFO:tasks.cephadm:Adding mds.k on trial091 2026-02-13T02:41:31.624 INFO:tasks.cephadm:Adding mds.c on trial154 2026-02-13T02:41:31.624 INFO:tasks.cephadm:Adding mds.f on trial154 2026-02-13T02:41:31.624 INFO:tasks.cephadm:Adding mds.i on trial154 2026-02-13T02:41:31.624 INFO:tasks.cephadm:Adding mds.l on trial154 2026-02-13T02:41:31.624 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph orch apply mds all '12;trial078=a;trial078=d;trial078=g;trial078=j;trial091=b;trial091=e;trial091=h;trial091=k;trial154=c;trial154=f;trial154=i;trial154=l' 2026-02-13T02:41:31.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:31 trial091 ceph-mon[27614]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T02:41:31.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:31 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4223681891' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:41:31.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:31 trial091 ceph-mon[27614]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:31.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:31 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1540574746' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:31.744 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.c/config 2026-02-13T02:41:31.863 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 -- 10.20.193.154:0/79083921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de4060720 msgr2=0x7f6de4060af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.863 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/79083921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de4060720 0x7f6de4060af0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=8077878553241013618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dd0009970 tx=0x7f6dd002ed20 comp rx=0 tx=0).stop 2026-02-13T02:41:31.863 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 -- 10.20.193.154:0/79083921 shutdown_connections 2026-02-13T02:41:31.863 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/79083921 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6de41556b0 0x7f6de4175a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.863 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/79083921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 0x7f6de4155170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/79083921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de4060720 0x7f6de4060af0 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=8077878553241013618 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 -- 10.20.193.154:0/79083921 >> 10.20.193.154:0/79083921 conn(0x7f6de40ea880 msgr2=0x7f6de410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 -- 10.20.193.154:0/79083921 shutdown_connections 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.856+0000 7f6deaf906c0 1 -- 10.20.193.154:0/79083921 wait complete. 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 Processor -- start 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 -- start start 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6de4060720 0x7f6de4161490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 0x7f6de41619d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de41556b0 0x7f6de4166d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6de41673e0 con 0x7f6de4060720 2026-02-13T02:41:31.864 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6de4167550 con 0x7f6de4061030 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6deaf906c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6de4167710 con 0x7f6de41556b0 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6de3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 0x7f6de41619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6de8d016c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6de4060720 0x7f6de4161490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6de3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 0x7f6de41619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.154:53854/0 (socket says 10.20.193.154:53854) 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6de3fff6c0 1 -- 10.20.193.154:0/1685307299 learned_addr learned my addr 10.20.193.154:0/1685307299 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.857+0000 7f6de3fff6c0 1 -- 10.20.193.154:0/1685307299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de41556b0 msgr2=0x7f6de4166d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de95026c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de41556b0 0x7f6de4166d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de3fff6c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de41556b0 0x7f6de4166d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de3fff6c0 1 -- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6de4060720 msgr2=0x7f6de4161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de3fff6c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6de4060720 0x7f6de4161490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de3fff6c0 1 -- 10.20.193.154:0/1685307299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd0009590 con 0x7f6de4061030 2026-02-13T02:41:31.865 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de8d016c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6de4060720 0x7f6de4161490 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de95026c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de41556b0 0x7f6de4166d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de3fff6c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 0x7f6de41619d0 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dcc005dc0 tx=0x7f6dcc00bbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de1ffb6c0 1 -- 10.20.193.154:0/1685307299 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dcc004250 con 0x7f6de4061030 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de1ffb6c0 1 -- 10.20.193.154:0/1685307299 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6dcc009070 con 0x7f6de4061030 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de41679f0 con 0x7f6de4061030 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6de1ffb6c0 1 -- 10.20.193.154:0/1685307299 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dcc00ce40 con 0x7f6de4061030 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de41512e0 con 0x7f6de4061030 2026-02-13T02:41:31.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.858+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de4061c30 con 0x7f6de4061030 2026-02-13T02:41:31.867 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.860+0000 7f6de1ffb6c0 1 -- 10.20.193.154:0/1685307299 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f6dcc0028c0 con 0x7f6de4061030 2026-02-13T02:41:31.867 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.860+0000 7f6de1ffb6c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6dac0b56d0 0x7f6dac0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:31.867 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.860+0000 7f6de1ffb6c0 1 -- 10.20.193.154:0/1685307299 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f6dcc0e3660 con 0x7f6de4061030 2026-02-13T02:41:31.867 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.861+0000 7f6de8d016c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6dac0b56d0 0x7f6dac0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:31.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.861+0000 7f6de1ffb6c0 1 -- 10.20.193.154:0/1685307299 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6dcc0a6470 con 0x7f6de4061030 2026-02-13T02:41:31.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.861+0000 7f6de8d016c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6dac0b56d0 0x7f6dac0d5b80 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dd002f970 tx=0x7f6dd00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:31.963 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.959+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial078=a;trial078=d;trial078=g;trial078=j;trial091=b;trial091=e;trial091=h;trial091=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}) -- 0x7f6de41625e0 con 0x7f6dac0b56d0 2026-02-13T02:41:31.967 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.963+0000 7f6de1ffb6c0 1 -- 10.20.193.154:0/1685307299 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6de41625e0 con 0x7f6dac0b56d0 2026-02-13T02:41:31.968 INFO:teuthology.orchestra.run.trial154.stdout:Scheduled mds.all update... 2026-02-13T02:41:31.969 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6dac0b56d0 msgr2=0x7f6dac0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.969 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6dac0b56d0 0x7f6dac0d5b80 secure :-1 s=READY pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dd002f970 tx=0x7f6dd00023a0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.969 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 msgr2=0x7f6de41619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:31.969 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 0x7f6de41619d0 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dcc005dc0 tx=0x7f6dcc00bbd0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.969 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 shutdown_connections 2026-02-13T02:41:31.969 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6dac0b56d0 0x7f6dac0d5b80 unknown :-1 s=CLOSED pgs=114 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.969 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6de41556b0 0x7f6de4166d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.970 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6de4061030 0x7f6de41619d0 unknown :-1 s=CLOSED pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.970 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 --2- 10.20.193.154:0/1685307299 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6de4060720 0x7f6de4161490 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:31.970 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 >> 10.20.193.154:0/1685307299 conn(0x7f6de40ea880 msgr2=0x7f6de410ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:31.970 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 shutdown_connections 2026-02-13T02:41:31.970 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T02:41:31.964+0000 7f6deaf906c0 1 -- 10.20.193.154:0/1685307299 wait complete. 2026-02-13T02:41:32.022 DEBUG:teuthology.orchestra.run.trial078:mds.a> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.a.service 2026-02-13T02:41:32.026 DEBUG:teuthology.orchestra.run.trial078:mds.d> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.d.service 2026-02-13T02:41:32.072 DEBUG:teuthology.orchestra.run.trial078:mds.g> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.g.service 2026-02-13T02:41:32.116 DEBUG:teuthology.orchestra.run.trial078:mds.j> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.j.service 2026-02-13T02:41:32.160 DEBUG:teuthology.orchestra.run.trial091:mds.b> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.b.service 2026-02-13T02:41:32.163 DEBUG:teuthology.orchestra.run.trial091:mds.e> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.e.service 2026-02-13T02:41:32.206 DEBUG:teuthology.orchestra.run.trial091:mds.h> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.h.service 2026-02-13T02:41:32.249 DEBUG:teuthology.orchestra.run.trial091:mds.k> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.k.service 2026-02-13T02:41:32.293 DEBUG:teuthology.orchestra.run.trial154:mds.c> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.c.service 2026-02-13T02:41:32.295 DEBUG:teuthology.orchestra.run.trial154:mds.f> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.f.service 2026-02-13T02:41:32.338 DEBUG:teuthology.orchestra.run.trial154:mds.i> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.i.service 2026-02-13T02:41:32.382 DEBUG:teuthology.orchestra.run.trial154:mds.l> sudo journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.l.service 2026-02-13T02:41:32.426 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T02:41:32.426 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:41:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/436274107' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T02:41:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:32.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:32.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:32.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:32.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:32.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:32.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:32 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/436274107' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:32.476 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:32 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/436274107' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:32.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:32 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:32.609 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:32.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.807+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/2514326992 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 msgr2=0x7fec0c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:32.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.807+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/2514326992 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 0x7fec0c10f430 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=14262688276461630232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf80099a0 tx=0x7febf802ed00 comp rx=0 tx=0).stop 2026-02-13T02:41:32.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.807+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/2514326992 shutdown_connections 2026-02-13T02:41:32.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.807+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/2514326992 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c115270 0x7fec0c175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.807+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/2514326992 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec0c10fa50 0x7fec0c114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.807+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/2514326992 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 0x7fec0c10f430 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=14262688276461630232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.807+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/2514326992 >> 10.20.193.78:0/2514326992 conn(0x7fec0c0ec980 msgr2=0x7fec0c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:32.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.808+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/2514326992 shutdown_connections 2026-02-13T02:41:32.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.808+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/2514326992 wait complete. 2026-02-13T02:41:32.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.808+0000 7fec10cbf6c0 1 Processor -- start 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec10cbf6c0 1 -- start start 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec10cbf6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 0x7fec0c11cfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec10cbf6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec0c115270 0x7fec0c11d500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec10cbf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c1228c0 0x7fec0c122d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec10cbf6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1232d0 con 0x7fec0c10f060 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec10cbf6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c123440 con 0x7fec0c1228c0 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec10cbf6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c123600 con 0x7fec0c115270 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c1228c0 0x7fec0c122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:32.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0affd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec0c115270 0x7fec0c11d500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c1228c0 0x7fec0c122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:43228/0 (socket says 10.20.193.78:43228) 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 -- 10.20.193.78:0/1298350322 learned_addr learned my addr 10.20.193.78:0/1298350322 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0b7fe6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 0x7fec0c11cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 -- 10.20.193.78:0/1298350322 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec0c115270 msgr2=0x7fec0c11d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec0c115270 0x7fec0c11d500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 -- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 msgr2=0x7fec0c11cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 0x7fec0c11cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.809+0000 7fec0bfff6c0 1 -- 10.20.193.78:0/1298350322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf8009590 con 0x7fec0c1228c0 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.810+0000 7fec0bfff6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c1228c0 0x7fec0c122d60 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec00006ea0 tx=0x7fec0000ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.810+0000 7fec08ff96c0 1 -- 10.20.193.78:0/1298350322 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec00003c40 con 0x7fec0c1228c0 2026-02-13T02:41:32.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.810+0000 7fec08ff96c0 1 -- 10.20.193.78:0/1298350322 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fec00003da0 con 0x7fec0c1228c0 2026-02-13T02:41:32.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.810+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0c163ab0 con 0x7fec0c1228c0 2026-02-13T02:41:32.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.810+0000 7fec08ff96c0 1 -- 10.20.193.78:0/1298350322 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec000081c0 con 0x7fec0c1228c0 2026-02-13T02:41:32.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.810+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0c163f40 con 0x7fec0c1228c0 2026-02-13T02:41:32.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.810+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0c110330 con 0x7fec0c1228c0 2026-02-13T02:41:32.815 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.813+0000 7fec08ff96c0 1 -- 10.20.193.78:0/1298350322 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fec00005030 con 0x7fec0c1228c0 2026-02-13T02:41:32.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.814+0000 7fec08ff96c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7febe00b5650 0x7febe00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:32.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.815+0000 7fec08ff96c0 1 -- 10.20.193.78:0/1298350322 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fec000e4870 con 0x7fec0c1228c0 2026-02-13T02:41:32.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.815+0000 7fec0b7fe6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7febe00b5650 0x7febe00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:32.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.815+0000 7fec08ff96c0 1 -- 10.20.193.78:0/1298350322 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fec000e4cf0 con 0x7fec0c1228c0 2026-02-13T02:41:32.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.815+0000 7fec0b7fe6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7febe00b5650 0x7febe00d5b00 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf8005b40 tx=0x7febf80023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:32.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.940+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec0c10fa50 con 0x7fec0c1228c0 2026-02-13T02:41:32.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.940+0000 7fec08ff96c0 1 -- 10.20.193.78:0/1298350322 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fec000a7680 con 0x7fec0c1228c0 2026-02-13T02:41:32.943 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:32.943 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":1,"btime":"2026-02-13T02:38:52:551729+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:dumped fsmap epoch 1 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7febe00b5650 msgr2=0x7febe00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7febe00b5650 0x7febe00d5b00 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf8005b40 tx=0x7febf80023a0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c1228c0 msgr2=0x7fec0c122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c1228c0 0x7fec0c122d60 secure :-1 s=READY pgs=80 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec00006ea0 tx=0x7fec0000ce50 comp rx=0 tx=0).stop 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 shutdown_connections 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7febe00b5650 0x7febe00d5b00 unknown :-1 s=CLOSED pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec0c1228c0 0x7fec0c122d60 unknown :-1 s=CLOSED pgs=80 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec0c115270 0x7fec0c11d500 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 --2- 10.20.193.78:0/1298350322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fec0c10f060 0x7fec0c11cfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:32.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 >> 10.20.193.78:0/1298350322 conn(0x7fec0c0ec980 msgr2=0x7fec0c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:32.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 shutdown_connections 2026-02-13T02:41:32.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:32.942+0000 7fec10cbf6c0 1 -- 10.20.193.78:0/1298350322 wait complete. 2026-02-13T02:41:33.338 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mon[27921]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial078=a;trial078=d;trial078=g;trial078=j;trial091=b;trial091=e;trial091=h;trial091=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:33.338 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mon[27921]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:33.338 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mon[27921]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:33.338 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:33.338 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:33.338 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:33.338 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1298350322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:33.339 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:41:33 trial154 podman[57293]: 2026-02-13 02:41:33.300431694 +0000 UTC m=+0.008843340 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:41:33.339 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:41:33 trial154 bash[57293]: 1f9d91b7f4d1128847d228afa25a815aaf0bd33a3893f09441c86a30fabfe83c 2026-02-13T02:41:33.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:33 trial078 ceph-mon[22944]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial078=a;trial078=d;trial078=g;trial078=j;trial091=b;trial091=e;trial091=h;trial091=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:33.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:33 trial078 ceph-mon[22944]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:33.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:33 trial078 ceph-mon[22944]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:33.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:33 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:33.477 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:33 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:33.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:33 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:33.478 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:33 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1298350322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:33.516 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:41:33 trial154 systemd[1]: Started Ceph mds.l for 1779b03c-0885-11f1-aeb9-d404e6e7d460. 2026-02-13T02:41:33.516 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:41:33 trial154 ceph-mds[57317]: -- 10.20.193.154:0/2822480129 <== mon.1 v2:10.20.193.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f88807860 con 0x557f888bd400 2026-02-13T02:41:33.516 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:41:33 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-l[57313]: starting mds.l at 2026-02-13T02:41:33.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:33 trial091 ceph-mon[27614]: from='client.24593 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial078=a;trial078=d;trial078=g;trial078=j;trial091=b;trial091=e;trial091=h;trial091=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:33.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:33 trial091 ceph-mon[27614]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:33.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:33 trial091 ceph-mon[27614]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:33.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:33 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:33.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:33 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:33.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:33 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:33.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:33 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1298350322' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:34.356 INFO:journalctl@ceph.mds.k.trial091.stdout:Feb 13 02:41:34 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-k[55914]: starting mds.k at 2026-02-13T02:41:34.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.154:6832/3544208376,v1:10.20.193.154:6833/3544208376] up:boot 2026-02-13T02:41:34.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: fsmap 1 up:standby 2026-02-13T02:41:34.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T02:41:34.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:34.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:34 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:34.711 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.154:6832/3544208376,v1:10.20.193.154:6833/3544208376] up:boot 2026-02-13T02:41:34.711 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: fsmap 1 up:standby 2026-02-13T02:41:34.711 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T02:41:34.711 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.711 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.711 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:34.712 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:34 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.154:6832/3544208376,v1:10.20.193.154:6833/3544208376] up:boot 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: fsmap 1 up:standby 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:34.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:34.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:34.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:34.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:34 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:35.049 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:41:35.238 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:35.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.450+0000 7feb8c8326c0 1 -- 10.20.193.78:0/3493237324 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810b8b0 msgr2=0x7feb8810bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:35.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.450+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/3493237324 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810b8b0 0x7feb8810bc80 secure :-1 s=READY pgs=79 gs=3 cs=0 l=1 c_cookie=5125331647226320850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb740098a0 tx=0x7feb7402ec50 comp rx=0 tx=0).stop 2026-02-13T02:41:35.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.451+0000 7feb8c8326c0 1 -- 10.20.193.78:0/3493237324 shutdown_connections 2026-02-13T02:41:35.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.451+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/3493237324 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb881555e0 0x7feb881759c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.451+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/3493237324 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810c1c0 0x7feb881550a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.451+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/3493237324 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810b8b0 0x7feb8810bc80 unknown :-1 s=CLOSED pgs=79 gs=3 cs=0 l=1 c_cookie=5125331647226320850 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.451+0000 7feb8c8326c0 1 -- 10.20.193.78:0/3493237324 >> 10.20.193.78:0/3493237324 conn(0x7feb880e9590 msgr2=0x7feb881099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:35.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.451+0000 7feb8c8326c0 1 -- 10.20.193.78:0/3493237324 shutdown_connections 2026-02-13T02:41:35.454 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.451+0000 7feb8c8326c0 1 -- 10.20.193.78:0/3493237324 wait complete. 2026-02-13T02:41:35.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 Processor -- start 2026-02-13T02:41:35.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 -- start start 2026-02-13T02:41:35.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810b8b0 0x7feb881602b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:35.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810c1c0 0x7feb881607f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:35.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb881555e0 0x7feb88165bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:35.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb88166200 con 0x7feb8810b8b0 2026-02-13T02:41:35.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7feb88166370 con 0x7feb881555e0 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.452+0000 7feb8c8326c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb88166530 con 0x7feb8810c1c0 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810b8b0 0x7feb881602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810b8b0 0x7feb881602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46962/0 (socket says 10.20.193.78:46962) 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 -- 10.20.193.78:0/795977369 learned_addr learned my addr 10.20.193.78:0/795977369 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb86ffd6c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810c1c0 0x7feb881607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb87fff6c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb881555e0 0x7feb88165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 -- 10.20.193.78:0/795977369 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810c1c0 msgr2=0x7feb881607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810c1c0 0x7feb881607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 -- 10.20.193.78:0/795977369 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb881555e0 msgr2=0x7feb88165bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb881555e0 0x7feb88165bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 -- 10.20.193.78:0/795977369 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb78009590 con 0x7feb8810b8b0 2026-02-13T02:41:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb877fe6c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810b8b0 0x7feb881602b0 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb7402fbe0 tx=0x7feb7402fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb84ff96c0 1 -- 10.20.193.78:0/795977369 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb74002ae0 con 0x7feb8810b8b0 2026-02-13T02:41:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb740094c0 con 0x7feb8810b8b0 2026-02-13T02:41:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb84ff96c0 1 -- 10.20.193.78:0/795977369 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb740076a0 con 0x7feb8810b8b0 2026-02-13T02:41:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb84ff96c0 1 -- 10.20.193.78:0/795977369 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb74002ae0 con 0x7feb8810b8b0 2026-02-13T02:41:35.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.453+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb88152070 con 0x7feb8810b8b0 2026-02-13T02:41:35.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.454+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8805fb30 con 0x7feb8810b8b0 2026-02-13T02:41:35.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.456+0000 7feb84ff96c0 1 -- 10.20.193.78:0/795977369 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7feb74002c40 con 0x7feb8810b8b0 2026-02-13T02:41:35.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.458+0000 7feb84ff96c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feb5c0b5710 0x7feb5c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:35.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.458+0000 7feb84ff96c0 1 -- 10.20.193.78:0/795977369 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7feb740ce6a0 con 0x7feb8810b8b0 2026-02-13T02:41:35.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.458+0000 7feb86ffd6c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feb5c0b5710 0x7feb5c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:35.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.458+0000 7feb84ff96c0 1 -- 10.20.193.78:0/795977369 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feb740ca490 con 0x7feb8810b8b0 2026-02-13T02:41:35.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.459+0000 7feb86ffd6c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feb5c0b5710 0x7feb5c0d5bc0 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb88166c40 tx=0x7feb78009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:35.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.590+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb88161400 con 0x7feb8810b8b0 2026-02-13T02:41:35.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.591+0000 7feb84ff96c0 1 -- 10.20.193.78:0/795977369 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7feb740ca630 con 0x7feb8810b8b0 2026-02-13T02:41:35.593 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:35.593 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":3,"btime":"2026-02-13T02:41:34:382053+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3544208376","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3544208376},{"type":"v1","addr":"10.20.193.154:6833","nonce":3544208376}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6833/891371423","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":891371423},{"type":"v1","addr":"10.20.193.91:6833","nonce":891371423}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T02:41:35.593 INFO:teuthology.orchestra.run.trial078.stderr:dumped fsmap epoch 3 2026-02-13T02:41:35.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.592+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feb5c0b5710 msgr2=0x7feb5c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.592+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feb5c0b5710 0x7feb5c0d5bc0 secure :-1 s=READY pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb88166c40 tx=0x7feb78009310 comp rx=0 tx=0).stop 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.592+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810b8b0 msgr2=0x7feb881602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.592+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810b8b0 0x7feb881602b0 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb7402fbe0 tx=0x7feb7402fc10 comp rx=0 tx=0).stop 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 shutdown_connections 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feb5c0b5710 0x7feb5c0d5bc0 unknown :-1 s=CLOSED pgs=118 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb881555e0 0x7feb88165bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb8810c1c0 0x7feb881607f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 --2- 10.20.193.78:0/795977369 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb8810b8b0 0x7feb881602b0 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 >> 10.20.193.78:0/795977369 conn(0x7feb880e9590 msgr2=0x7feb88109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:35.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 shutdown_connections 2026-02-13T02:41:35.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:35.593+0000 7feb8c8326c0 1 -- 10.20.193.78:0/795977369 wait complete. 2026-02-13T02:41:35.609 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:35 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.91:6832/891371423,v1:10.20.193.91:6833/891371423] up:boot 2026-02-13T02:41:35.609 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:35 trial078 ceph-mon[22944]: fsmap 2 up:standby 2026-02-13T02:41:35.609 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T02:41:35.609 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:35 trial078 ceph-mon[22944]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:35.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:35 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.91:6832/891371423,v1:10.20.193.91:6833/891371423] up:boot 2026-02-13T02:41:35.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:35 trial091 ceph-mon[27614]: fsmap 2 up:standby 2026-02-13T02:41:35.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T02:41:35.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:35 trial091 ceph-mon[27614]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:35 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.91:6832/891371423,v1:10.20.193.91:6833/891371423] up:boot 2026-02-13T02:41:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:35 trial154 ceph-mon[27921]: fsmap 2 up:standby 2026-02-13T02:41:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T02:41:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:35 trial154 ceph-mon[27921]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:36.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:36 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/795977369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:36.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:36.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:36.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:36.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:36 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/795977369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:36.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:36.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:36.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:36 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/795977369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:37.227 INFO:journalctl@ceph.mds.d.trial078.stdout:Feb 13 02:41:36 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-d[57523]: starting mds.d at 2026-02-13T02:41:37.692 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.78:6834/414968217,v1:10.20.193.78:6835/414968217] up:boot 2026-02-13T02:41:37.692 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: fsmap 3 up:standby 2026-02-13T02:41:37.692 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T02:41:37.693 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:37.693 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.693 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.693 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.693 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:37.693 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:37.693 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:37.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.78:6834/414968217,v1:10.20.193.78:6835/414968217] up:boot 2026-02-13T02:41:37.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: fsmap 3 up:standby 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:37.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:37.735 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.78:6834/414968217,v1:10.20.193.78:6835/414968217] up:boot 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: fsmap 3 up:standby 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:37.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:37.925 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:37.945 INFO:journalctl@ceph.mds.e.trial091.stdout:Feb 13 02:41:37 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-e[56236]: starting mds.e at 2026-02-13T02:41:38.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 -- 10.20.193.78:0/1221729907 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10d9a0 msgr2=0x7fd76c1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:38.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 --2- 10.20.193.78:0/1221729907 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10d9a0 0x7fd76c1129e0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=6992440918386653139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7600099a0 tx=0x7fd76002ed00 comp rx=0 tx=0).stop 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 -- 10.20.193.78:0/1221729907 shutdown_connections 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 --2- 10.20.193.78:0/1221729907 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd76c1131c0 0x7fd76c173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 --2- 10.20.193.78:0/1221729907 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10d9a0 0x7fd76c1129e0 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=6992440918386653139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 --2- 10.20.193.78:0/1221729907 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd76c10cfb0 0x7fd76c10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 -- 10.20.193.78:0/1221729907 >> 10.20.193.78:0/1221729907 conn(0x7fd76c0ea8b0 msgr2=0x7fd76c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 -- 10.20.193.78:0/1221729907 shutdown_connections 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.131+0000 7fd773d3c6c0 1 -- 10.20.193.78:0/1221729907 wait complete. 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 Processor -- start 2026-02-13T02:41:38.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 -- start start 2026-02-13T02:41:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10cfb0 0x7fd76c0f4bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd76c1131c0 0x7fd76c173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd76c0f51e0 0x7fd76c0fa4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c0f58d0 con 0x7fd76c10cfb0 2026-02-13T02:41:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c0fa9f0 con 0x7fd76c1131c0 2026-02-13T02:41:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd773d3c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c0fabb0 con 0x7fd76c0f51e0 2026-02-13T02:41:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10cfb0 0x7fd76c0f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10cfb0 0x7fd76c0f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:52024/0 (socket says 10.20.193.78:52024) 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 -- 10.20.193.78:0/458691945 learned_addr learned my addr 10.20.193.78:0/458691945 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd7712b06c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd76c1131c0 0x7fd76c173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd7722b26c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd76c0f51e0 0x7fd76c0fa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 -- 10.20.193.78:0/458691945 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd76c0f51e0 msgr2=0x7fd76c0fa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd76c0f51e0 0x7fd76c0fa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 -- 10.20.193.78:0/458691945 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd76c1131c0 msgr2=0x7fd76c173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd76c1131c0 0x7fd76c173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.132+0000 7fd771ab16c0 1 -- 10.20.193.78:0/458691945 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd760009590 con 0x7fd76c10cfb0 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.133+0000 7fd771ab16c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10cfb0 0x7fd76c0f4bb0 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd75c009490 tx=0x7fd75c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.133+0000 7fd75affd6c0 1 -- 10.20.193.78:0/458691945 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd75c004a80 con 0x7fd76c10cfb0 2026-02-13T02:41:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.133+0000 7fd75affd6c0 1 -- 10.20.193.78:0/458691945 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd75c009030 con 0x7fd76c10cfb0 2026-02-13T02:41:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.133+0000 7fd75affd6c0 1 -- 10.20.193.78:0/458691945 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd75c0071c0 con 0x7fd76c10cfb0 2026-02-13T02:41:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.133+0000 7fd773d3c6c0 1 -- 10.20.193.78:0/458691945 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c0fae90 con 0x7fd76c10cfb0 2026-02-13T02:41:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.133+0000 7fd773d3c6c0 1 -- 10.20.193.78:0/458691945 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c0fb620 con 0x7fd76c10cfb0 2026-02-13T02:41:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.133+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd76c10e280 con 0x7fd76c10cfb0 2026-02-13T02:41:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.135+0000 7fd75affd6c0 1 -- 10.20.193.78:0/458691945 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fd75c005000 con 0x7fd76c10cfb0 2026-02-13T02:41:38.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.137+0000 7fd75affd6c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd7480b56d0 0x7fd7480d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:38.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.137+0000 7fd75affd6c0 1 -- 10.20.193.78:0/458691945 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fd75c0e3670 con 0x7fd76c10cfb0 2026-02-13T02:41:38.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.137+0000 7fd7712b06c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd7480b56d0 0x7fd7480d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:38.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.137+0000 7fd75affd6c0 1 -- 10.20.193.78:0/458691945 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd75c0e3af0 con 0x7fd76c10cfb0 2026-02-13T02:41:38.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.138+0000 7fd7712b06c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd7480b56d0 0x7fd7480d5b80 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd76c0fb540 tx=0x7fd7600023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:38.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.260+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd76c0f5d00 con 0x7fd76c10cfb0 2026-02-13T02:41:38.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.260+0000 7fd75affd6c0 1 -- 10.20.193.78:0/458691945 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7fd75c0a6480 con 0x7fd76c10cfb0 2026-02-13T02:41:38.262 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:38.262 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":5,"btime":"2026-02-13T02:41:37:392496+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6837/689282216","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":689282216},{"type":"v1","addr":"10.20.193.78:6837","nonce":689282216}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3544208376","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3544208376},{"type":"v1","addr":"10.20.193.154:6833","nonce":3544208376}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6833/891371423","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":891371423},{"type":"v1","addr":"10.20.193.91:6833","nonce":891371423}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24616,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6835/414968217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":414968217},{"type":"v1","addr":"10.20.193.78:6835","nonce":414968217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2026-02-13T02:41:38.263 INFO:teuthology.orchestra.run.trial078.stderr:dumped fsmap epoch 5 2026-02-13T02:41:38.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd7480b56d0 msgr2=0x7fd7480d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:38.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd7480b56d0 0x7fd7480d5b80 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd76c0fb540 tx=0x7fd7600023a0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10cfb0 msgr2=0x7fd76c0f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:38.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10cfb0 0x7fd76c0f4bb0 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd75c009490 tx=0x7fd75c00bca0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 shutdown_connections 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd7480b56d0 0x7fd7480d5b80 unknown :-1 s=CLOSED pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd76c0f51e0 0x7fd76c0fa4b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd76c1131c0 0x7fd76c173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 --2- 10.20.193.78:0/458691945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd76c10cfb0 0x7fd76c0f4bb0 unknown :-1 s=CLOSED pgs=147 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 >> 10.20.193.78:0/458691945 conn(0x7fd76c0ea8b0 msgr2=0x7fd76c10b470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 shutdown_connections 2026-02-13T02:41:38.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:38.261+0000 7fd758ff96c0 1 -- 10.20.193.78:0/458691945 wait complete. 2026-02-13T02:41:38.506 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.78:6836/689282216,v1:10.20.193.78:6837/689282216] up:boot 2026-02-13T02:41:38.506 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: fsmap 4 up:standby 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:38.507 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:38 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/458691945' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.78:6836/689282216,v1:10.20.193.78:6837/689282216] up:boot 2026-02-13T02:41:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: fsmap 4 up:standby 2026-02-13T02:41:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T02:41:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:38.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:38.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:38.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:38 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/458691945' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.78:6836/689282216,v1:10.20.193.78:6837/689282216] up:boot 2026-02-13T02:41:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: fsmap 4 up:standby 2026-02-13T02:41:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T02:41:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:38.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:38.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:38.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:38 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/458691945' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:38.766 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 02:41:38 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-f[57636]: starting mds.f at 2026-02-13T02:41:39.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.91:6834/2299414444,v1:10.20.193.91:6835/2299414444] up:boot 2026-02-13T02:41:39.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: fsmap 5 up:standby 2026-02-13T02:41:39.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T02:41:39.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:39.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:39.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:39.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:39 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:39.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.91:6834/2299414444,v1:10.20.193.91:6835/2299414444] up:boot 2026-02-13T02:41:39.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: fsmap 5 up:standby 2026-02-13T02:41:39.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T02:41:39.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:39.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:39.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:39.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:39 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:39.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.91:6834/2299414444,v1:10.20.193.91:6835/2299414444] up:boot 2026-02-13T02:41:39.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: fsmap 5 up:standby 2026-02-13T02:41:39.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T02:41:39.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:39.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:39.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:39.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:39.767 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:39.767 INFO:journalctl@ceph.mds.c.trial154.stdout:Feb 13 02:41:39 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-c[57961]: starting mds.c at 2026-02-13T02:41:40.399 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:41:40.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.154:6834/361176953,v1:10.20.193.154:6835/361176953] up:boot 2026-02-13T02:41:40.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: fsmap 6 up:standby 2026-02-13T02:41:40.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T02:41:40.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:40.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:40 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:40.585 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:40.663 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.154:6834/361176953,v1:10.20.193.154:6835/361176953] up:boot 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: fsmap 6 up:standby 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:40.664 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.665 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.665 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.665 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:40.665 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:40.665 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:40 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:40.667 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.154:6834/361176953,v1:10.20.193.154:6835/361176953] up:boot 2026-02-13T02:41:40.667 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: fsmap 6 up:standby 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:40.668 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:40.669 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:40 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:40.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/1032108919 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 msgr2=0x7f2fc4060af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:40.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/1032108919 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4060af0 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=10412844637518578891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fb4009970 tx=0x7f2fb402ed50 comp rx=0 tx=0).stop 2026-02-13T02:41:40.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/1032108919 shutdown_connections 2026-02-13T02:41:40.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/1032108919 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2fc4155510 0x7f2fc41758f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/1032108919 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2fc4061030 0x7f2fc4154fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/1032108919 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4060af0 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=10412844637518578891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/1032108919 >> 10.20.193.78:0/1032108919 conn(0x7f2fc40ea6a0 msgr2=0x7f2fc410aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:40.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/1032108919 shutdown_connections 2026-02-13T02:41:40.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.776+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/1032108919 wait complete. 2026-02-13T02:41:40.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 Processor -- start 2026-02-13T02:41:40.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 -- start start 2026-02-13T02:41:40.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4161320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:40.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2fc4061030 0x7f2fc4161860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2fc4155510 0x7f2fc4166c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4167270 con 0x7f2fc4060720 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41673e0 con 0x7f2fc4155510 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fca3cb6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41675a0 con 0x7f2fc4061030 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fc93c96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4161320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fc93c96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4161320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:52040/0 (socket says 10.20.193.78:52040) 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fc93c96c0 1 -- 10.20.193.78:0/2034273947 learned_addr learned my addr 10.20.193.78:0/2034273947 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fc8bc86c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2fc4061030 0x7f2fc4161860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.777+0000 7f2fc9bca6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2fc4155510 0x7f2fc4166c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:40.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc9bca6c0 1 -- 10.20.193.78:0/2034273947 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2fc4061030 msgr2=0x7f2fc4161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc9bca6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2fc4061030 0x7f2fc4161860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc9bca6c0 1 -- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 msgr2=0x7f2fc4161320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc9bca6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4161320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc9bca6c0 1 -- 10.20.193.78:0/2034273947 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb4009590 con 0x7f2fc4155510 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc8bc86c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2fc4061030 0x7f2fc4161860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc93c96c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4161320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fc9bca6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2fc4155510 0x7f2fc4166c20 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fc000c6c0 tx=0x7f2fc000cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fb27fc6c0 1 -- 10.20.193.78:0/2034273947 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2fc0005340 con 0x7f2fc4155510 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc4167880 con 0x7f2fc4155510 2026-02-13T02:41:40.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fb27fc6c0 1 -- 10.20.193.78:0/2034273947 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2fc0003cf0 con 0x7f2fc4155510 2026-02-13T02:41:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fb27fc6c0 1 -- 10.20.193.78:0/2034273947 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2fc000dc80 con 0x7f2fc4155510 2026-02-13T02:41:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.778+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc4151140 con 0x7f2fc4155510 2026-02-13T02:41:40.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.779+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4061c30 con 0x7f2fc4155510 2026-02-13T02:41:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.781+0000 7f2fb27fc6c0 1 -- 10.20.193.78:0/2034273947 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f2fc0003810 con 0x7f2fc4155510 2026-02-13T02:41:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.783+0000 7f2fb27fc6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2fa00b56d0 0x7f2fa00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.783+0000 7f2fb27fc6c0 1 -- 10.20.193.78:0/2034273947 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f2fc00e45a0 con 0x7f2fc4155510 2026-02-13T02:41:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.783+0000 7f2fb27fc6c0 1 -- 10.20.193.78:0/2034273947 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2fc00e4a90 con 0x7f2fc4155510 2026-02-13T02:41:40.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.783+0000 7f2fc93c96c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2fa00b56d0 0x7f2fa00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:40.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.783+0000 7f2fc93c96c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2fa00b56d0 0x7f2fa00d5b80 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fb40023e0 tx=0x7f2fb4005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:40.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.906+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fc4162470 con 0x7f2fc4155510 2026-02-13T02:41:40.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.906+0000 7f2fb27fc6c0 1 -- 10.20.193.78:0/2034273947 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+7207 (secure 0 0 0) 0x7f2fc00a73f0 con 0x7f2fc4155510 2026-02-13T02:41:40.908 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:40.909 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":8,"btime":"2026-02-13T02:41:40:404638+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6837/689282216","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":689282216},{"type":"v1","addr":"10.20.193.78:6837","nonce":689282216}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3544208376","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3544208376},{"type":"v1","addr":"10.20.193.154:6833","nonce":3544208376}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6833/891371423","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":891371423},{"type":"v1","addr":"10.20.193.91:6833","nonce":891371423}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24616,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6835/414968217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":414968217},{"type":"v1","addr":"10.20.193.78:6835","nonce":414968217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2299414444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2299414444},{"type":"v1","addr":"10.20.193.91:6835","nonce":2299414444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6835/361176953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":361176953},{"type":"v1","addr":"10.20.193.154:6835","nonce":361176953}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6837/2809281421","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":2809281421},{"type":"v1","addr":"10.20.193.154:6837","nonce":2809281421}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/3322558145","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":3322558145},{"type":"v1","addr":"10.20.193.91:6837","nonce":3322558145}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T02:41:40.909 INFO:teuthology.orchestra.run.trial078.stderr:dumped fsmap epoch 8 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2fa00b56d0 msgr2=0x7f2fa00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2fa00b56d0 0x7f2fa00d5b80 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fb40023e0 tx=0x7f2fb4005ae0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2fc4155510 msgr2=0x7f2fc4166c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2fc4155510 0x7f2fc4166c20 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fc000c6c0 tx=0x7f2fc000cb90 comp rx=0 tx=0).stop 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 shutdown_connections 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2fa00b56d0 0x7f2fa00d5b80 unknown :-1 s=CLOSED pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2fc4155510 0x7f2fc4166c20 unknown :-1 s=CLOSED pgs=87 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2fc4061030 0x7f2fc4161860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 --2- 10.20.193.78:0/2034273947 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fc4060720 0x7f2fc4161320 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:40.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.907+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 >> 10.20.193.78:0/2034273947 conn(0x7f2fc40ea6a0 msgr2=0x7f2fc410aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:40.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.908+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 shutdown_connections 2026-02-13T02:41:40.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:40.908+0000 7f2fca3cb6c0 1 -- 10.20.193.78:0/2034273947 wait complete. 2026-02-13T02:41:41.266 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 02:41:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-i[58286]: starting mds.i at 2026-02-13T02:41:41.672 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.154:6836/2809281421,v1:10.20.193.154:6837/2809281421] up:boot 2026-02-13T02:41:41.672 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.91:6836/3322558145,v1:10.20.193.91:6837/3322558145] up:boot 2026-02-13T02:41:41.672 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: fsmap 8 up:standby 2026-02-13T02:41:41.672 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T02:41:41.672 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2034273947' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:41.673 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:41 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:41.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.154:6836/2809281421,v1:10.20.193.154:6837/2809281421] up:boot 2026-02-13T02:41:41.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.91:6836/3322558145,v1:10.20.193.91:6837/3322558145] up:boot 2026-02-13T02:41:41.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: fsmap 8 up:standby 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2034273947' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:41.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:41 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.154:6836/2809281421,v1:10.20.193.154:6837/2809281421] up:boot 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.91:6836/3322558145,v1:10.20.193.91:6837/3322558145] up:boot 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: fsmap 8 up:standby 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2034273947' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:41.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:41 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:42.416 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 systemd[1]: Starting Ceph mds.g for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:41:42.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:42 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.154:6838/4001660484,v1:10.20.193.154:6839/4001660484] up:boot 2026-02-13T02:41:42.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:42 trial091 ceph-mon[27614]: fsmap 9 up:standby 2026-02-13T02:41:42.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:42 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T02:41:42.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:42 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.154:6838/4001660484,v1:10.20.193.154:6839/4001660484] up:boot 2026-02-13T02:41:42.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:42 trial078 ceph-mon[22944]: fsmap 9 up:standby 2026-02-13T02:41:42.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:42 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T02:41:42.728 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 podman[57972]: 2026-02-13 02:41:42.457983214 +0000 UTC m=+0.029468665 container create db5658b89be10974c1ed79fe5855d802de8c482458760304fb1c7f2a938191f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-g, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:41:42.728 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 podman[57972]: 2026-02-13 02:41:42.500119155 +0000 UTC m=+0.071604606 container init db5658b89be10974c1ed79fe5855d802de8c482458760304fb1c7f2a938191f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-g, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, summary=Rocky Linux Base image, name=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, license=BSD-3-Clause, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:41:42.728 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 podman[57972]: 2026-02-13 02:41:42.504790401 +0000 UTC m=+0.076275852 container start db5658b89be10974c1ed79fe5855d802de8c482458760304fb1c7f2a938191f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-g, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, version=10, ceph=True, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:41:42.728 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 bash[57972]: db5658b89be10974c1ed79fe5855d802de8c482458760304fb1c7f2a938191f0 2026-02-13T02:41:42.728 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 podman[57972]: 2026-02-13 02:41:42.446932023 +0000 UTC m=+0.018417474 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:41:42.728 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 systemd[1]: Started Ceph mds.g for 1779b03c-0885-11f1-aeb9-d404e6e7d460. 2026-02-13T02:41:42.728 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 ceph-mds[57991]: -- 10.20.193.78:0/2242854369 <== mon.2 v2:10.20.193.91:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c30f939860 con 0x55c30f9da400 2026-02-13T02:41:42.729 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:41:42 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-g[57987]: starting mds.g at 2026-02-13T02:41:42.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:42 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.154:6838/4001660484,v1:10.20.193.154:6839/4001660484] up:boot 2026-02-13T02:41:42.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:42 trial154 ceph-mon[27921]: fsmap 9 up:standby 2026-02-13T02:41:42.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:42 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T02:41:43.011 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:41:43.218 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:43.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 -- 10.20.193.78:0/875567803 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93741198f0 msgr2=0x7f937417a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:43.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/875567803 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93741198f0 0x7f937417a2c0 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=364026409611092603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f937000aa40 tx=0x7f937002fde0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 -- 10.20.193.78:0/875567803 shutdown_connections 2026-02-13T02:41:43.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/875567803 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93741198f0 0x7f937417a2c0 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=364026409611092603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/875567803 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9374114190 0x7f9374119140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/875567803 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93741137a0 0x7f9374113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 -- 10.20.193.78:0/875567803 >> 10.20.193.78:0/875567803 conn(0x7f9374060760 msgr2=0x7f9374060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:43.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.592+0000 7f937b08c6c0 1 -- 10.20.193.78:0/875567803 shutdown_connections 2026-02-13T02:41:43.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.593+0000 7f937b08c6c0 1 -- 10.20.193.78:0/875567803 wait complete. 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 Processor -- start 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 -- start start 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93741137a0 0x7f93741215c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93741198f0 0x7f9374121b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9374126ec0 0x7f9374127360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f93741278d0 con 0x7f9374126ec0 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9374127a40 con 0x7f93741137a0 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f937b08c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9374127c00 con 0x7f93741198f0 2026-02-13T02:41:43.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f9378e016c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93741137a0 0x7f93741215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f936bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93741198f0 0x7f9374121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f9378e016c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93741137a0 0x7f93741215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:48170/0 (socket says 10.20.193.78:48170) 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f9378e016c0 1 -- 10.20.193.78:0/2952250981 learned_addr learned my addr 10.20.193.78:0/2952250981 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f93796026c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9374126ec0 0x7f9374127360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f936bfff6c0 1 -- 10.20.193.78:0/2952250981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93741137a0 msgr2=0x7f93741215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f936bfff6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93741137a0 0x7f93741215c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f936bfff6c0 1 -- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9374126ec0 msgr2=0x7f9374127360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f936bfff6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9374126ec0 0x7f9374127360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.594+0000 7f936bfff6c0 1 -- 10.20.193.78:0/2952250981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937000a660 con 0x7f93741198f0 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.595+0000 7f9378e016c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93741137a0 0x7f93741215c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:43.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.595+0000 7f936bfff6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93741198f0 0x7f9374121b00 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935c00b6e0 tx=0x7f935c00bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:43.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.595+0000 7f9369ffb6c0 1 -- 10.20.193.78:0/2952250981 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f935c004a80 con 0x7f93741198f0 2026-02-13T02:41:43.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.595+0000 7f9369ffb6c0 1 -- 10.20.193.78:0/2952250981 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f935c009030 con 0x7f93741198f0 2026-02-13T02:41:43.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.595+0000 7f9369ffb6c0 1 -- 10.20.193.78:0/2952250981 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f935c00cd40 con 0x7f93741198f0 2026-02-13T02:41:43.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.595+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93741680b0 con 0x7f93741198f0 2026-02-13T02:41:43.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.595+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9374168510 con 0x7f93741198f0 2026-02-13T02:41:43.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.596+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93741149e0 con 0x7f93741198f0 2026-02-13T02:41:43.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.598+0000 7f9369ffb6c0 1 -- 10.20.193.78:0/2952250981 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f935c004060 con 0x7f93741198f0 2026-02-13T02:41:43.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.600+0000 7f9369ffb6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f93500b5650 0x7f93500d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:43.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.600+0000 7f9369ffb6c0 1 -- 10.20.193.78:0/2952250981 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f935c0e3650 con 0x7f93741198f0 2026-02-13T02:41:43.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.600+0000 7f9369ffb6c0 1 -- 10.20.193.78:0/2952250981 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f935c0e3ad0 con 0x7f93741198f0 2026-02-13T02:41:43.602 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:43.602 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:43.602 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:43.603 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:43.603 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:43.603 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:43.603 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:43.603 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.78:6838/1269487135,v1:10.20.193.78:6839/1269487135] up:boot 2026-02-13T02:41:43.603 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: fsmap 10 up:standby 2026-02-13T02:41:43.603 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:43 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T02:41:43.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.600+0000 7f9378e016c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f93500b5650 0x7f93500d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:43.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.601+0000 7f9378e016c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f93500b5650 0x7f93500d5b00 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9364009240 tx=0x7f9364009420 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:43.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.725+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9374113b70 con 0x7f93741198f0 2026-02-13T02:41:43.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.725+0000 7f9369ffb6c0 1 -- 10.20.193.78:0/2952250981 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8862 (secure 0 0 0) 0x7f935c0a6460 con 0x7f93741198f0 2026-02-13T02:41:43.728 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:43.728 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":10,"btime":"2026-02-13T02:41:43:414709+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6837/689282216","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":689282216},{"type":"v1","addr":"10.20.193.78:6837","nonce":689282216}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14649,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6839/1269487135","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6838","nonce":1269487135},{"type":"v1","addr":"10.20.193.78:6839","nonce":1269487135}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3544208376","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3544208376},{"type":"v1","addr":"10.20.193.154:6833","nonce":3544208376}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6833/891371423","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":891371423},{"type":"v1","addr":"10.20.193.91:6833","nonce":891371423}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24616,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6835/414968217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":414968217},{"type":"v1","addr":"10.20.193.78:6835","nonce":414968217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2299414444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2299414444},{"type":"v1","addr":"10.20.193.91:6835","nonce":2299414444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6835/361176953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":361176953},{"type":"v1","addr":"10.20.193.154:6835","nonce":361176953}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6837/2809281421","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":2809281421},{"type":"v1","addr":"10.20.193.154:6837","nonce":2809281421}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6839/4001660484","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6838","nonce":4001660484},{"type":"v1","addr":"10.20.193.154:6839","nonce":4001660484}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/3322558145","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":3322558145},{"type":"v1","addr":"10.20.193.91:6837","nonce":3322558145}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T02:41:43.728 INFO:teuthology.orchestra.run.trial078.stderr:dumped fsmap epoch 10 2026-02-13T02:41:43.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.727+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f93500b5650 msgr2=0x7f93500d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.727+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f93500b5650 0x7f93500d5b00 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9364009240 tx=0x7f9364009420 comp rx=0 tx=0).stop 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.727+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93741198f0 msgr2=0x7f9374121b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.727+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93741198f0 0x7f9374121b00 secure :-1 s=READY pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f935c00b6e0 tx=0x7f935c00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 shutdown_connections 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f93500b5650 0x7f93500d5b00 unknown :-1 s=CLOSED pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9374126ec0 0x7f9374127360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93741198f0 0x7f9374121b00 unknown :-1 s=CLOSED pgs=87 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 --2- 10.20.193.78:0/2952250981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93741137a0 0x7f93741215c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:43.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 >> 10.20.193.78:0/2952250981 conn(0x7f9374060760 msgr2=0x7f93741167b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:43.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 shutdown_connections 2026-02-13T02:41:43.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:43.728+0000 7f937b08c6c0 1 -- 10.20.193.78:0/2952250981 wait complete. 2026-02-13T02:41:43.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:43.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:43.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:43.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:43.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:43.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:43.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:43.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.78:6838/1269487135,v1:10.20.193.78:6839/1269487135] up:boot 2026-02-13T02:41:43.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: fsmap 10 up:standby 2026-02-13T02:41:43.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:43 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.78:6838/1269487135,v1:10.20.193.78:6839/1269487135] up:boot 2026-02-13T02:41:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: fsmap 10 up:standby 2026-02-13T02:41:44.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:43 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T02:41:44.227 INFO:journalctl@ceph.mds.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-a[58351]: starting mds.a at 2026-02-13T02:41:44.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2952250981' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:44.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:44.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:44.696 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2952250981' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:44.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:44 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:44 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2952250981' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:44 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:44 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:44 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:44 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:41:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:44 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:41:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:44 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:45.195 INFO:journalctl@ceph.mds.b.trial091.stdout:Feb 13 02:41:44 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-b[56883]: starting mds.b at 2026-02-13T02:41:45.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:45.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.78:6840/2991369082,v1:10.20.193.78:6841/2991369082] up:boot 2026-02-13T02:41:45.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: fsmap 11 up:standby 2026-02-13T02:41:45.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T02:41:45.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:45.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:45 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.836 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:41:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.78:6840/2991369082,v1:10.20.193.78:6841/2991369082] up:boot 2026-02-13T02:41:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: fsmap 11 up:standby 2026-02-13T02:41:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T02:41:45.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:45.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:45.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:45 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.78:6840/2991369082,v1:10.20.193.78:6841/2991369082] up:boot 2026-02-13T02:41:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: fsmap 11 up:standby 2026-02-13T02:41:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T02:41:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:46.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:45 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.022 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:46.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 -- 10.20.193.78:0/1019785258 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40114190 msgr2=0x7f7f40115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/1019785258 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40114190 0x7f7f40115d40 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=10763383932528836765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f2c0099a0 tx=0x7f7f2c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 -- 10.20.193.78:0/1019785258 shutdown_connections 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/1019785258 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7f40116520 0x7f7f4017a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/1019785258 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40114190 0x7f7f40115d40 unknown :-1 s=CLOSED pgs=152 gs=1 cs=0 l=1 c_cookie=10763383932528836765 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/1019785258 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f401137a0 0x7f7f40113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 -- 10.20.193.78:0/1019785258 >> 10.20.193.78:0/1019785258 conn(0x7f7f40061510 msgr2=0x7f7f40061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 -- 10.20.193.78:0/1019785258 shutdown_connections 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.232+0000 7f7f476e76c0 1 -- 10.20.193.78:0/1019785258 wait complete. 2026-02-13T02:41:46.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.233+0000 7f7f476e76c0 1 Processor -- start 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.233+0000 7f7f476e76c0 1 -- start start 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f476e76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7f401137a0 0x7f7f401214e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f476e76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f40116520 0x7f7f40121a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f476e76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40126de0 0x7f7f40127280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f476e76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7f401277f0 con 0x7f7f40126de0 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f476e76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7f40127960 con 0x7f7f401137a0 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f476e76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f40127b20 con 0x7f7f40116520 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f45ee46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f40116520 0x7f7f40121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f45ee46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f40116520 0x7f7f40121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:51704/0 (socket says 10.20.193.78:51704) 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f45ee46c0 1 -- 10.20.193.78:0/229255169 learned_addr learned my addr 10.20.193.78:0/229255169 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:46.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f46ee66c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40126de0 0x7f7f40127280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f466e56c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7f401137a0 0x7f7f401214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f46ee66c0 1 -- 10.20.193.78:0/229255169 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f40116520 msgr2=0x7f7f40121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f46ee66c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f40116520 0x7f7f40121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f46ee66c0 1 -- 10.20.193.78:0/229255169 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7f401137a0 msgr2=0x7f7f401214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f46ee66c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7f401137a0 0x7f7f401214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f46ee66c0 1 -- 10.20.193.78:0/229255169 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c009590 con 0x7f7f40126de0 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f466e56c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7f401137a0 0x7f7f401214e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f45ee46c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f40116520 0x7f7f40121a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.234+0000 7f7f46ee66c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40126de0 0x7f7f40127280 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f3400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.235+0000 7f7f2b7fe6c0 1 -- 10.20.193.78:0/229255169 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f34003c40 con 0x7f7f40126de0 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.235+0000 7f7f2b7fe6c0 1 -- 10.20.193.78:0/229255169 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7f3400a070 con 0x7f7f40126de0 2026-02-13T02:41:46.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.235+0000 7f7f2b7fe6c0 1 -- 10.20.193.78:0/229255169 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f3400dd90 con 0x7f7f40126de0 2026-02-13T02:41:46.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.235+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f40167fd0 con 0x7f7f40126de0 2026-02-13T02:41:46.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.235+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f40168460 con 0x7f7f40126de0 2026-02-13T02:41:46.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.235+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f40114840 con 0x7f7f40126de0 2026-02-13T02:41:46.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.237+0000 7f7f2b7fe6c0 1 -- 10.20.193.78:0/229255169 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7f34005030 con 0x7f7f40126de0 2026-02-13T02:41:46.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.239+0000 7f7f2b7fe6c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7f1c0b56d0 0x7f7f1c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.239+0000 7f7f2b7fe6c0 1 -- 10.20.193.78:0/229255169 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f7f340e46b0 con 0x7f7f40126de0 2026-02-13T02:41:46.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.239+0000 7f7f466e56c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7f1c0b56d0 0x7f7f1c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.239+0000 7f7f2b7fe6c0 1 -- 10.20.193.78:0/229255169 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7f340e4b30 con 0x7f7f40126de0 2026-02-13T02:41:46.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.240+0000 7f7f466e56c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7f1c0b56d0 0x7f7f1c0d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f38004750 tx=0x7f7f38009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:46.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.364+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f40113b70 con 0x7f7f40126de0 2026-02-13T02:41:46.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.364+0000 7f7f2b7fe6c0 1 -- 10.20.193.78:0/229255169 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+10514 (secure 0 0 0) 0x7f7f340a74c0 con 0x7f7f40126de0 2026-02-13T02:41:46.367 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:46.367 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":12,"btime":"2026-02-13T02:41:45:574414+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6837/689282216","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":689282216},{"type":"v1","addr":"10.20.193.78:6837","nonce":689282216}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14649,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6839/1269487135","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6838","nonce":1269487135},{"type":"v1","addr":"10.20.193.78:6839","nonce":1269487135}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3544208376","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3544208376},{"type":"v1","addr":"10.20.193.154:6833","nonce":3544208376}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6833/891371423","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":891371423},{"type":"v1","addr":"10.20.193.91:6833","nonce":891371423}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24616,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6835/414968217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":414968217},{"type":"v1","addr":"10.20.193.78:6835","nonce":414968217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24635,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2299414444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2299414444},{"type":"v1","addr":"10.20.193.91:6835","nonce":2299414444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6835/361176953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":361176953},{"type":"v1","addr":"10.20.193.154:6835","nonce":361176953}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6837/2809281421","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":2809281421},{"type":"v1","addr":"10.20.193.154:6837","nonce":2809281421}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24655,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6839/4001660484","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6838","nonce":4001660484},{"type":"v1","addr":"10.20.193.154:6839","nonce":4001660484}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/3322558145","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":3322558145},{"type":"v1","addr":"10.20.193.91:6837","nonce":3322558145}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6841/2991369082","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6840","nonce":2991369082},{"type":"v1","addr":"10.20.193.78:6841","nonce":2991369082}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24692,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6839/1775632234","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6838","nonce":1775632234},{"type":"v1","addr":"10.20.193.91:6839","nonce":1775632234}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2026-02-13T02:41:46.367 INFO:teuthology.orchestra.run.trial078.stderr:dumped fsmap epoch 12 2026-02-13T02:41:46.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.366+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7f1c0b56d0 msgr2=0x7f7f1c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.366+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7f1c0b56d0 0x7f7f1c0d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f38004750 tx=0x7f7f38009260 comp rx=0 tx=0).stop 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.366+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40126de0 msgr2=0x7f7f40127280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.366+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40126de0 0x7f7f40127280 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f3400cc00 comp rx=0 tx=0).stop 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 shutdown_connections 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7f1c0b56d0 0x7f7f1c0d5b80 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7f40126de0 0x7f7f40127280 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7f40116520 0x7f7f40121a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 --2- 10.20.193.78:0/229255169 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7f401137a0 0x7f7f401214e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 >> 10.20.193.78:0/229255169 conn(0x7f7f40061510 msgr2=0x7f7f40114d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:46.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 shutdown_connections 2026-02-13T02:41:46.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.367+0000 7f7f476e76c0 1 -- 10.20.193.78:0/229255169 wait complete. 2026-02-13T02:41:46.511 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T02:41:46.698 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:46.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.91:6838/1775632234,v1:10.20.193.91:6839/1775632234] up:boot 2026-02-13T02:41:46.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: fsmap 12 up:standby 2026-02-13T02:41:46.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T02:41:46.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.728 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:46 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/229255169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 -- 10.20.193.78:0/2427296929 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064115270 msgr2=0x7f0064175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 --2- 10.20.193.78:0/2427296929 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064115270 0x7f0064175c10 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=8646034905454357682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00540099a0 tx=0x7f005402ed00 comp rx=0 tx=0).stop 2026-02-13T02:41:46.905 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 -- 10.20.193.78:0/2427296929 shutdown_connections 2026-02-13T02:41:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 --2- 10.20.193.78:0/2427296929 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064115270 0x7f0064175c10 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=8646034905454357682 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 --2- 10.20.193.78:0/2427296929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f006410fa50 0x7f0064114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 --2- 10.20.193.78:0/2427296929 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 0x7f006410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 -- 10.20.193.78:0/2427296929 >> 10.20.193.78:0/2427296929 conn(0x7f00640ec980 msgr2=0x7f006410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 -- 10.20.193.78:0/2427296929 shutdown_connections 2026-02-13T02:41:46.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.903+0000 7f00688246c0 1 -- 10.20.193.78:0/2427296929 wait complete. 2026-02-13T02:41:46.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 Processor -- start 2026-02-13T02:41:46.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 -- start start 2026-02-13T02:41:46.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 0x7f006411cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0064115270 0x7f006411d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064122860 0x7f0064122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0064123270 con 0x7f0064115270 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f00641233e0 con 0x7f006410f060 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f00688246c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00641235a0 con 0x7f0064122860 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f0062d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 0x7f006411cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f0062d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 0x7f006411cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:53682/0 (socket says 10.20.193.78:53682) 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.904+0000 7f0062d766c0 1 -- 10.20.193.78:0/3249146198 learned_addr learned my addr 10.20.193.78:0/3249146198 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f00635776c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064122860 0x7f0064122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f00625756c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0064115270 0x7f006411d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f0062d766c0 1 -- 10.20.193.78:0/3249146198 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064122860 msgr2=0x7f0064122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f0062d766c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064122860 0x7f0064122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f0062d766c0 1 -- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0064115270 msgr2=0x7f006411d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:46.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f0062d766c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0064115270 0x7f006411d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f0062d766c0 1 -- 10.20.193.78:0/3249146198 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0054009590 con 0x7f006410f060 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f0062d766c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 0x7f006411cf60 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0050006ea0 tx=0x7f005000ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f005bfff6c0 1 -- 10.20.193.78:0/3249146198 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0050003c40 con 0x7f006410f060 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f005bfff6c0 1 -- 10.20.193.78:0/3249146198 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0050003da0 con 0x7f006410f060 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f00688246c0 1 -- 10.20.193.78:0/3249146198 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0064163a50 con 0x7f006410f060 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f00688246c0 1 -- 10.20.193.78:0/3249146198 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0064163ee0 con 0x7f006410f060 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.905+0000 7f005bfff6c0 1 -- 10.20.193.78:0/3249146198 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00500081c0 con 0x7f006410f060 2026-02-13T02:41:46.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.906+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0064110330 con 0x7f006410f060 2026-02-13T02:41:46.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.908+0000 7f005bfff6c0 1 -- 10.20.193.78:0/3249146198 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0050005030 con 0x7f006410f060 2026-02-13T02:41:46.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.910+0000 7f005bfff6c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f003c0b5650 0x7f003c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:46.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.910+0000 7f005bfff6c0 1 -- 10.20.193.78:0/3249146198 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f00500e49e0 con 0x7f006410f060 2026-02-13T02:41:46.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.910+0000 7f00625756c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f003c0b5650 0x7f003c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:46.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.910+0000 7f005bfff6c0 1 -- 10.20.193.78:0/3249146198 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00500e4e60 con 0x7f006410f060 2026-02-13T02:41:46.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:46.911+0000 7f00625756c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f003c0b5650 0x7f003c0d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00641238f0 tx=0x7f0048009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:46.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.91:6838/1775632234,v1:10.20.193.91:6839/1775632234] up:boot 2026-02-13T02:41:46.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: fsmap 12 up:standby 2026-02-13T02:41:46.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T02:41:46.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:46.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:46 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/229255169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:47.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.011+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f006410f430 con 0x7f006410f060 2026-02-13T02:41:47.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.011+0000 7f005bfff6c0 1 -- 10.20.193.78:0/3249146198 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f00500a77f0 con 0x7f006410f060 2026-02-13T02:41:47.014 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:47.014 INFO:teuthology.orchestra.run.trial078.stdout:[ 2026-02-13T02:41:47.014 INFO:teuthology.orchestra.run.trial078.stdout: { 2026-02-13T02:41:47.014 INFO:teuthology.orchestra.run.trial078.stdout: "poolnum": 1, 2026-02-13T02:41:47.014 INFO:teuthology.orchestra.run.trial078.stdout: "poolname": ".mgr" 2026-02-13T02:41:47.015 INFO:teuthology.orchestra.run.trial078.stdout: } 2026-02-13T02:41:47.015 INFO:teuthology.orchestra.run.trial078.stdout:] 2026-02-13T02:41:47.015 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f003c0b5650 msgr2=0x7f003c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f003c0b5650 0x7f003c0d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00641238f0 tx=0x7f0048009260 comp rx=0 tx=0).stop 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 msgr2=0x7f006411cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 0x7f006411cf60 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0050006ea0 tx=0x7f005000ced0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 shutdown_connections 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f003c0b5650 0x7f003c0d5b00 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0064122860 0x7f0064122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0064115270 0x7f006411d4a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 --2- 10.20.193.78:0/3249146198 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f006410f060 0x7f006411cf60 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 >> 10.20.193.78:0/3249146198 conn(0x7f00640ec980 msgr2=0x7f006410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:47.016 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 shutdown_connections 2026-02-13T02:41:47.017 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.013+0000 7f0059ffb6c0 1 -- 10.20.193.78:0/3249146198 wait complete. 2026-02-13T02:41:47.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.91:6838/1775632234,v1:10.20.193.91:6839/1775632234] up:boot 2026-02-13T02:41:47.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: fsmap 12 up:standby 2026-02-13T02:41:47.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T02:41:47.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.018 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:46 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/229255169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:41:47.153 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T02:41:47.153 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T02:41:47.337 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:47.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f043affd6c0 1 -- 10.20.193.78:0/3999206616 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04300081c0 con 0x7f043c1199a0 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f04416b26c0 1 -- 10.20.193.78:0/3999206616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 msgr2=0x7f043c116df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f04416b26c0 1 --2- 10.20.193.78:0/3999206616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 0x7f043c116df0 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=760160369082011585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f043000aa40 tx=0x7f043002fdf0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f04416b26c0 1 -- 10.20.193.78:0/3999206616 shutdown_connections 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f04416b26c0 1 --2- 10.20.193.78:0/3999206616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 0x7f043c116df0 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=760160369082011585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f04416b26c0 1 --2- 10.20.193.78:0/3999206616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c118f30 0x7f043c119380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f04416b26c0 1 --2- 10.20.193.78:0/3999206616 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f043c11b3f0 0x7f043c11b7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.525+0000 7f04416b26c0 1 -- 10.20.193.78:0/3999206616 >> 10.20.193.78:0/3999206616 conn(0x7f043c05b290 msgr2=0x7f043c05b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:47.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.526+0000 7f04416b26c0 1 -- 10.20.193.78:0/3999206616 shutdown_connections 2026-02-13T02:41:47.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.526+0000 7f04416b26c0 1 -- 10.20.193.78:0/3999206616 wait complete. 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.526+0000 7f04416b26c0 1 Processor -- start 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.526+0000 7f04416b26c0 1 -- start start 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f04416b26c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f043c118f30 0x7f043c0fdcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f04416b26c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 0x7f043c0fe210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f04416b26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c11b3f0 0x7f043c103530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f04416b26c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f043c103b30 con 0x7f043c1199a0 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f04416b26c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f043c103ca0 con 0x7f043c11b3f0 2026-02-13T02:41:47.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f04416b26c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f043c103e60 con 0x7f043c118f30 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f043b7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 0x7f043c0fe210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f0440eb16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c11b3f0 0x7f043c103530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f043bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f043c118f30 0x7f043c0fdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f0440eb16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c11b3f0 0x7f043c103530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:53688/0 (socket says 10.20.193.78:53688) 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f0440eb16c0 1 -- 10.20.193.78:0/2305445227 learned_addr learned my addr 10.20.193.78:0/2305445227 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f043b7fe6c0 1 -- 10.20.193.78:0/2305445227 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f043c118f30 msgr2=0x7f043c0fdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f043b7fe6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f043c118f30 0x7f043c0fdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f043b7fe6c0 1 -- 10.20.193.78:0/2305445227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c11b3f0 msgr2=0x7f043c103530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f043b7fe6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c11b3f0 0x7f043c103530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f043b7fe6c0 1 -- 10.20.193.78:0/2305445227 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043000a660 con 0x7f043c1199a0 2026-02-13T02:41:47.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.527+0000 7f0440eb16c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c11b3f0 0x7f043c103530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:47.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.528+0000 7f043b7fe6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 0x7f043c0fe210 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f042c00b6e0 tx=0x7f042c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:47.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.528+0000 7f04397fa6c0 1 -- 10.20.193.78:0/2305445227 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f042c004a80 con 0x7f043c1199a0 2026-02-13T02:41:47.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.528+0000 7f04397fa6c0 1 -- 10.20.193.78:0/2305445227 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f042c009030 con 0x7f043c1199a0 2026-02-13T02:41:47.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.528+0000 7f04397fa6c0 1 -- 10.20.193.78:0/2305445227 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f042c00cd40 con 0x7f043c1199a0 2026-02-13T02:41:47.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.528+0000 7f04416b26c0 1 -- 10.20.193.78:0/2305445227 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c104140 con 0x7f043c1199a0 2026-02-13T02:41:47.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.528+0000 7f04416b26c0 1 -- 10.20.193.78:0/2305445227 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c104850 con 0x7f043c1199a0 2026-02-13T02:41:47.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.528+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043c104360 con 0x7f043c1199a0 2026-02-13T02:41:47.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.531+0000 7f04397fa6c0 1 -- 10.20.193.78:0/2305445227 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f042c004060 con 0x7f043c1199a0 2026-02-13T02:41:47.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.532+0000 7f04397fa6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04100b56d0 0x7f04100d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:47.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.532+0000 7f04397fa6c0 1 -- 10.20.193.78:0/2305445227 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f042c0e3520 con 0x7f043c1199a0 2026-02-13T02:41:47.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.532+0000 7f04397fa6c0 1 -- 10.20.193.78:0/2305445227 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f042c0e39a0 con 0x7f043c1199a0 2026-02-13T02:41:47.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.532+0000 7f043bfff6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04100b56d0 0x7f04100d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:47.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.533+0000 7f043bfff6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04100b56d0 0x7f04100d5b80 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0428004750 tx=0x7f0428009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:47.611 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:47.611 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3249146198' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T02:41:47.611 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:47.611 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:47.611 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.611 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:47.612 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:47.612 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:47.612 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:47.612 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:47 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:41:47.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:47.632+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f043c05e670 con 0x7f043c1199a0 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3249146198' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:47.635 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:47.636 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:47 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:41:47.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:47.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3249146198' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T02:41:47.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:47.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:47.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:47.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:47.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:47.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:47.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:41:47.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:47 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:41:48.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.586+0000 7f04397fa6c0 1 -- 10.20.193.78:0/2305445227 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f042c0a6330 con 0x7f043c1199a0 2026-02-13T02:41:48.589 INFO:teuthology.orchestra.run.trial078.stderr:pool 'cephfs_metadata' created 2026-02-13T02:41:48.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.590+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04100b56d0 msgr2=0x7f04100d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.590+0000 7f040effd6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04100b56d0 0x7f04100d5b80 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0428004750 tx=0x7f0428009260 comp rx=0 tx=0).stop 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.590+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 msgr2=0x7f043c0fe210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.590+0000 7f040effd6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 0x7f043c0fe210 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f042c00b6e0 tx=0x7f042c00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 shutdown_connections 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04100b56d0 0x7f04100d5b80 unknown :-1 s=CLOSED pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f043c11b3f0 0x7f043c103530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f043c1199a0 0x7f043c0fe210 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 --2- 10.20.193.78:0/2305445227 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f043c118f30 0x7f043c0fdcd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:48.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 >> 10.20.193.78:0/2305445227 conn(0x7f043c05b290 msgr2=0x7f043c0f73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:48.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 shutdown_connections 2026-02-13T02:41:48.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:48.591+0000 7f040effd6c0 1 -- 10.20.193.78:0/2305445227 wait complete. 2026-02-13T02:41:48.704 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T02:41:48.889 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:48.933 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:48.933 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2305445227' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T02:41:48.933 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:48.934 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:48.934 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:48.934 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:48.934 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:48.934 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:48 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:48.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:48.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2305445227' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T02:41:48.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:48.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:48.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:48.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:48.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:48.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:48 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2305445227' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T02:41:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:41:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:48 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/3832758369 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5984115270 msgr2=0x7f5984175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:49.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/3832758369 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5984115270 0x7f5984175c10 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=8238045437801897424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f598000aa40 tx=0x7f598002fde0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/3832758369 shutdown_connections 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/3832758369 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5984115270 0x7f5984175c10 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=8238045437801897424 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/3832758369 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f598410fa50 0x7f5984114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/3832758369 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f598410f060 0x7f598410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/3832758369 >> 10.20.193.78:0/3832758369 conn(0x7f59840ec980 msgr2=0x7f598410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/3832758369 shutdown_connections 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.083+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/3832758369 wait complete. 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 Processor -- start 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 -- start start 2026-02-13T02:41:49.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f598410f060 0x7f598411cef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5984115270 0x7f598411d430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f59841227f0 0x7f5984122c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5984123200 con 0x7f598410f060 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5984123370 con 0x7f59841227f0 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598aa3b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5984123530 con 0x7f5984115270 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f5989a396c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f598410f060 0x7f598411cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f59892386c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5984115270 0x7f598411d430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f59892386c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5984115270 0x7f598411d430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:51756/0 (socket says 10.20.193.78:51756) 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f59892386c0 1 -- 10.20.193.78:0/2227239228 learned_addr learned my addr 10.20.193.78:0/2227239228 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:49.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.084+0000 7f598a23a6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f59841227f0 0x7f5984122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598a23a6c0 1 -- 10.20.193.78:0/2227239228 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5984115270 msgr2=0x7f598411d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598a23a6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5984115270 0x7f598411d430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598a23a6c0 1 -- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f598410f060 msgr2=0x7f598411cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598a23a6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f598410f060 0x7f598411cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598a23a6c0 1 -- 10.20.193.78:0/2227239228 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59740094c0 con 0x7f59841227f0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598a23a6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f59841227f0 0x7f5984122c90 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f598000aa40 tx=0x7f59800054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f59737fe6c0 1 -- 10.20.193.78:0/2227239228 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5980030da0 con 0x7f59841227f0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f59737fe6c0 1 -- 10.20.193.78:0/2227239228 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f59800309b0 con 0x7f59841227f0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f59737fe6c0 1 -- 10.20.193.78:0/2227239228 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5980032920 con 0x7f59841227f0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598000a660 con 0x7f59841227f0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.085+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5984163bf0 con 0x7f59841227f0 2026-02-13T02:41:49.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.086+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5984110330 con 0x7f59841227f0 2026-02-13T02:41:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.087+0000 7f59737fe6c0 1 -- 10.20.193.78:0/2227239228 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f5980032030 con 0x7f59841227f0 2026-02-13T02:41:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.090+0000 7f59737fe6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59540b56d0 0x7f59540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.090+0000 7f59737fe6c0 1 -- 10.20.193.78:0/2227239228 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7492+0+0 (secure 0 0 0) 0x7f5980108b50 con 0x7f59841227f0 2026-02-13T02:41:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.090+0000 7f5989a396c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59540b56d0 0x7f59540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.090+0000 7f59737fe6c0 1 -- 10.20.193.78:0/2227239228 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f59801415e0 con 0x7f59841227f0 2026-02-13T02:41:49.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.090+0000 7f5989a396c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59540b56d0 0x7f59540d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5974004750 tx=0x7f5974009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:49.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.189+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f598410f430 con 0x7f59841227f0 2026-02-13T02:41:49.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.592+0000 7f59737fe6c0 1 -- 10.20.193.78:0/2227239228 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f59800cf240 con 0x7f59841227f0 2026-02-13T02:41:49.595 INFO:teuthology.orchestra.run.trial078.stderr:pool 'cephfs_data' created 2026-02-13T02:41:49.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59540b56d0 msgr2=0x7f59540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:49.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59540b56d0 0x7f59540d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5974004750 tx=0x7f5974009260 comp rx=0 tx=0).stop 2026-02-13T02:41:49.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f59841227f0 msgr2=0x7f5984122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:49.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f59841227f0 0x7f5984122c90 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f598000aa40 tx=0x7f59800054b0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 shutdown_connections 2026-02-13T02:41:49.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f59540b56d0 0x7f59540d5b80 unknown :-1 s=CLOSED pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f59841227f0 0x7f5984122c90 unknown :-1 s=CLOSED pgs=93 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5984115270 0x7f598411d430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 --2- 10.20.193.78:0/2227239228 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f598410f060 0x7f598411cef0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:49.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 >> 10.20.193.78:0/2227239228 conn(0x7f59840ec980 msgr2=0x7f598410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:49.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 shutdown_connections 2026-02-13T02:41:49.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:49.596+0000 7f598aa3b6c0 1 -- 10.20.193.78:0/2227239228 wait complete. 2026-02-13T02:41:49.703 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T02:41:49.888 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:49.931 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:49.931 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2305445227' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T02:41:49.931 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T02:41:49.931 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.931 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.931 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:49.931 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:49.932 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.932 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:49.932 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:49.932 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:49.932 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:41:49.932 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:49 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2227239228' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:41:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2305445227' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T02:41:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T02:41:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:41:49.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:49 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2227239228' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:41:50.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:41:50.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2305445227' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T02:41:50.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T02:41:50.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:50.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:41:50.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:49 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2227239228' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:41:50.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 -- 10.20.193.78:0/2353466751 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c0622d0 msgr2=0x7f382c0607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:50.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 --2- 10.20.193.78:0/2353466751 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c0622d0 0x7f382c0607a0 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=9806376005336178069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3818009970 tx=0x7f381802ed50 comp rx=0 tx=0).stop 2026-02-13T02:41:50.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 -- 10.20.193.78:0/2353466751 shutdown_connections 2026-02-13T02:41:50.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 --2- 10.20.193.78:0/2353466751 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c159910 0x7f382c179cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:50.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 --2- 10.20.193.78:0/2353466751 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f382c060ce0 0x7f382c061110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:50.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 --2- 10.20.193.78:0/2353466751 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c0622d0 0x7f382c0607a0 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=9806376005336178069 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:50.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 -- 10.20.193.78:0/2353466751 >> 10.20.193.78:0/2353466751 conn(0x7f382c0ea6d0 msgr2=0x7f382c10aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:50.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 -- 10.20.193.78:0/2353466751 shutdown_connections 2026-02-13T02:41:50.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.076+0000 7f38309326c0 1 -- 10.20.193.78:0/2353466751 wait complete. 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 Processor -- start 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 -- start start 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c060ce0 0x7f382c0f20e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f382c0622d0 0x7f382c0f2620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c159910 0x7f382c0f79e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0f8030 con 0x7f382c0622d0 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0f81a0 con 0x7f382c159910 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f38309326c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f382c0f8360 con 0x7f382c060ce0 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f382affd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f382c0622d0 0x7f382c0f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:50.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f382b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c060ce0 0x7f382c0f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f382b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c060ce0 0x7f382c0f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:51774/0 (socket says 10.20.193.78:51774) 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f382b7fe6c0 1 -- 10.20.193.78:0/2905533559 learned_addr learned my addr 10.20.193.78:0/2905533559 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.077+0000 7f382bfff6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c159910 0x7f382c0f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382affd6c0 1 -- 10.20.193.78:0/2905533559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c060ce0 msgr2=0x7f382c0f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382affd6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c060ce0 0x7f382c0f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382affd6c0 1 -- 10.20.193.78:0/2905533559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c159910 msgr2=0x7f382c0f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382affd6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c159910 0x7f382c0f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382affd6c0 1 -- 10.20.193.78:0/2905533559 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c0094c0 con 0x7f382c0622d0 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382bfff6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c159910 0x7f382c0f79e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382b7fe6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c060ce0 0x7f382c0f20e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:50.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f382affd6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f382c0622d0 0x7f382c0f2620 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381c00ba30 tx=0x7f381c00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:50.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f3828ff96c0 1 -- 10.20.193.78:0/2905533559 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f381c004250 con 0x7f382c0622d0 2026-02-13T02:41:50.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3818009590 con 0x7f382c0622d0 2026-02-13T02:41:50.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c0f8b50 con 0x7f382c0622d0 2026-02-13T02:41:50.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f3828ff96c0 1 -- 10.20.193.78:0/2905533559 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f381c009030 con 0x7f382c0622d0 2026-02-13T02:41:50.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.078+0000 7f3828ff96c0 1 -- 10.20.193.78:0/2905533559 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f381c00ce70 con 0x7f382c0622d0 2026-02-13T02:41:50.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.079+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f382c061cb0 con 0x7f382c0622d0 2026-02-13T02:41:50.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.081+0000 7f3828ff96c0 1 -- 10.20.193.78:0/2905533559 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f381c0028c0 con 0x7f382c0622d0 2026-02-13T02:41:50.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.083+0000 7f3828ff96c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f38000b56d0 0x7f38000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:50.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.083+0000 7f3828ff96c0 1 -- 10.20.193.78:0/2905533559 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7877+0+0 (secure 0 0 0) 0x7f381c0e3b00 con 0x7f382c0622d0 2026-02-13T02:41:50.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.083+0000 7f3828ff96c0 1 -- 10.20.193.78:0/2905533559 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f381c11c5e0 con 0x7f382c0622d0 2026-02-13T02:41:50.085 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.083+0000 7f382b7fe6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f38000b56d0 0x7f38000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:50.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.084+0000 7f382b7fe6c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f38000b56d0 0x7f38000d5b80 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38180023e0 tx=0x7f3818005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:50.210 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:50.208+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f382c0f3260 con 0x7f382c0622d0 2026-02-13T02:41:50.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:50 trial091 ceph-mon[27614]: pgmap v173: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:50.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:50 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T02:41:50.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:50 trial091 ceph-mon[27614]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T02:41:50.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:50 trial091 ceph-mon[27614]: pgmap v175: 97 pgs: 13 creating+peering, 83 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:50.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:50 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2905533559' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T02:41:50.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:50 trial091 ceph-mon[27614]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T02:41:50.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:50 trial078 ceph-mon[22944]: pgmap v173: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:50.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:50 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T02:41:50.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:50 trial078 ceph-mon[22944]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T02:41:50.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:50 trial078 ceph-mon[22944]: pgmap v175: 97 pgs: 13 creating+peering, 83 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:50.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:50 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2905533559' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T02:41:50.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:50 trial078 ceph-mon[22944]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T02:41:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:50 trial154 ceph-mon[27921]: pgmap v173: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:50 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T02:41:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:50 trial154 ceph-mon[27921]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T02:41:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:50 trial154 ceph-mon[27921]: pgmap v175: 97 pgs: 13 creating+peering, 83 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:50 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2905533559' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T02:41:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:50 trial154 ceph-mon[27921]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T02:41:51.033 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.032+0000 7f3828ff96c0 1 -- 10.20.193.78:0/2905533559 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v13) ==== 172+0+0 (secure 0 0 0) 0x7f381c0a6610 con 0x7f382c0622d0 2026-02-13T02:41:51.034 INFO:teuthology.orchestra.run.trial078.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T02:41:51.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f38000b56d0 msgr2=0x7f38000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:51.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f38000b56d0 0x7f38000d5b80 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38180023e0 tx=0x7f3818005ae0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f382c0622d0 msgr2=0x7f382c0f2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:51.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f382c0622d0 0x7f382c0f2620 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f381c00ba30 tx=0x7f381c00bf00 comp rx=0 tx=0).stop 2026-02-13T02:41:51.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 shutdown_connections 2026-02-13T02:41:51.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f38000b56d0 0x7f38000d5b80 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f382c159910 0x7f382c0f79e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f382c0622d0 0x7f382c0f2620 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 --2- 10.20.193.78:0/2905533559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f382c060ce0 0x7f382c0f20e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 >> 10.20.193.78:0/2905533559 conn(0x7f382c0ea6d0 msgr2=0x7f382c10da40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:51.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 shutdown_connections 2026-02-13T02:41:51.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.037+0000 7f38309326c0 1 -- 10.20.193.78:0/2905533559 wait complete. 2026-02-13T02:41:51.147 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:41:51.331 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:51.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 -- 10.20.193.78:0/3011185836 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c114190 msgr2=0x7ff42c115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3011185836 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c114190 0x7ff42c115d40 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=5672336625374155211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4200099a0 tx=0x7ff42002ed00 comp rx=0 tx=0).stop 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 -- 10.20.193.78:0/3011185836 shutdown_connections 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3011185836 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff42c116520 0x7ff42c17a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3011185836 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c114190 0x7ff42c115d40 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=5672336625374155211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3011185836 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff42c1137a0 0x7ff42c113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 -- 10.20.193.78:0/3011185836 >> 10.20.193.78:0/3011185836 conn(0x7ff42c061510 msgr2=0x7ff42c061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 -- 10.20.193.78:0/3011185836 shutdown_connections 2026-02-13T02:41:51.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.536+0000 7ff4325526c0 1 -- 10.20.193.78:0/3011185836 wait complete. 2026-02-13T02:41:51.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 Processor -- start 2026-02-13T02:41:51.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 -- start start 2026-02-13T02:41:51.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff42c1137a0 0x7ff42c121560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff42c116520 0x7ff42c121aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c126e60 0x7ff42c127300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c127870 con 0x7ff42c126e60 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c1279e0 con 0x7ff42c116520 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4325526c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c127ba0 con 0x7ff42c1137a0 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff431d516c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c126e60 0x7ff42c127300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff430d4f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff42c116520 0x7ff42c121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff4315506c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff42c1137a0 0x7ff42c121560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff431d516c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c126e60 0x7ff42c127300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46666/0 (socket says 10.20.193.78:46666) 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.537+0000 7ff431d516c0 1 -- 10.20.193.78:0/3195975242 learned_addr learned my addr 10.20.193.78:0/3195975242 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:51.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff430d4f6c0 1 -- 10.20.193.78:0/3195975242 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff42c1137a0 msgr2=0x7ff42c121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff430d4f6c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff42c1137a0 0x7ff42c121560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff430d4f6c0 1 -- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c126e60 msgr2=0x7ff42c127300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff430d4f6c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c126e60 0x7ff42c127300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff430d4f6c0 1 -- 10.20.193.78:0/3195975242 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff420009590 con 0x7ff42c116520 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff431d516c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c126e60 0x7ff42c127300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff430d4f6c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff42c116520 0x7ff42c121aa0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff42c055f10 tx=0x7ff42002fce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff41a7fc6c0 1 -- 10.20.193.78:0/3195975242 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff420002ae0 con 0x7ff42c116520 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c167ff0 con 0x7ff42c116520 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c168470 con 0x7ff42c116520 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff41a7fc6c0 1 -- 10.20.193.78:0/3195975242 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4200091a0 con 0x7ff42c116520 2026-02-13T02:41:51.542 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.538+0000 7ff41a7fc6c0 1 -- 10.20.193.78:0/3195975242 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4200362d0 con 0x7ff42c116520 2026-02-13T02:41:51.543 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.539+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c114840 con 0x7ff42c116520 2026-02-13T02:41:51.544 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.542+0000 7ff41a7fc6c0 1 -- 10.20.193.78:0/3195975242 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff4200078d0 con 0x7ff42c116520 2026-02-13T02:41:51.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.543+0000 7ff41a7fc6c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4080b5750 0x7ff4080d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:51.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.543+0000 7ff41a7fc6c0 1 -- 10.20.193.78:0/3195975242 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7ff420107a80 con 0x7ff42c116520 2026-02-13T02:41:51.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.544+0000 7ff41a7fc6c0 1 -- 10.20.193.78:0/3195975242 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4201405e0 con 0x7ff42c116520 2026-02-13T02:41:51.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.544+0000 7ff4315506c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4080b5750 0x7ff4080d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:51.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.544+0000 7ff4315506c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4080b5750 0x7ff4080d5c00 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff41c004750 tx=0x7ff41c009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:51.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.644+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff42c1226b0 con 0x7ff42c116520 2026-02-13T02:41:51.646 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:51 trial078 ceph-mon[22944]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T02:41:51.646 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:51 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2905533559' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T02:41:51.646 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:51 trial078 ceph-mon[22944]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T02:41:51.647 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:51 trial078 ceph-mon[22944]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T02:41:51.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.645+0000 7ff41a7fc6c0 1 -- 10.20.193.78:0/3195975242 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22316 (secure 0 0 0) 0x7ff4200ca530 con 0x7ff42c116520 2026-02-13T02:41:51.647 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:51.648 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":75,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","created":"2026-02-13T02:38:52.551926+0000","modified":"2026-02-13T02:41:51.594154+0000","last_up_change":"2026-02-13T02:41:29.235143+0000","last_in_change":"2026-02-13T02:41:20.987708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:40:11.017308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:41:47.641058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:41:49.198912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4e99f87-c52f-4ab4-9ef0-2fc796b8084f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6803","nonce":2712462435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6805","nonce":2712462435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6809","nonce":2712462435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6807","nonce":2712462435}]},"public_addr":"10.20.193.78:6803/2712462435","cluster_addr":"10.20.193.78:6805/2712462435","heartbeat_back_addr":"10.20.193.78:6809/2712462435","heartbeat_front_addr":"10.20.193.78:6807/2712462435","state":["exists","up"]},{"osd":1,"uuid":"75b41a4c-dddc-4c29-885c-997d3f7212c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6800","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6801","nonce":196768757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6803","nonce":196768757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6807","nonce":196768757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6805","nonce":196768757}]},"public_addr":"10.20.193.91:6801/196768757","cluster_addr":"10.20.193.91:6803/196768757","heartbeat_back_addr":"10.20.193.91:6807/196768757","heartbeat_front_addr":"10.20.193.91:6805/196768757","state":["exists","up"]},{"osd":2,"uuid":"2697034a-905b-4bdb-adb4-4f945060e9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6801","nonce":2640210611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6803","nonce":2640210611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6807","nonce":2640210611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6805","nonce":2640210611}]},"public_addr":"10.20.193.154:6801/2640210611","cluster_addr":"10.20.193.154:6803/2640210611","heartbeat_back_addr":"10.20.193.154:6807/2640210611","heartbeat_front_addr":"10.20.193.154:6805/2640210611","state":["exists","up"]},{"osd":3,"uuid":"520c54bf-23d1-4eee-9bb8-a89711e96784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6811","nonce":71468509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6813","nonce":71468509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6817","nonce":71468509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6815","nonce":71468509}]},"public_addr":"10.20.193.78:6811/71468509","cluster_addr":"10.20.193.78:6813/71468509","heartbeat_back_addr":"10.20.193.78:6817/71468509","heartbeat_front_addr":"10.20.193.78:6815/71468509","state":["exists","up"]},{"osd":4,"uuid":"a4c56acb-cf6d-4fb7-a682-d848d6b2651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6809","nonce":4184387195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6811","nonce":4184387195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6815","nonce":4184387195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6813","nonce":4184387195}]},"public_addr":"10.20.193.91:6809/4184387195","cluster_addr":"10.20.193.91:6811/4184387195","heartbeat_back_addr":"10.20.193.91:6815/4184387195","heartbeat_front_addr":"10.20.193.91:6813/4184387195","state":["exists","up"]},{"osd":5,"uuid":"1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6809","nonce":1052719265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6811","nonce":1052719265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6815","nonce":1052719265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6813","nonce":1052719265}]},"public_addr":"10.20.193.154:6809/1052719265","cluster_addr":"10.20.193.154:6811/1052719265","heartbeat_back_addr":"10.20.193.154:6815/1052719265","heartbeat_front_addr":"10.20.193.154:6813/1052719265","state":["exists","up"]},{"osd":6,"uuid":"0cdd77aa-b764-4477-b092-4863371bead5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6819","nonce":1255269393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6821","nonce":1255269393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6825","nonce":1255269393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6823","nonce":1255269393}]},"public_addr":"10.20.193.78:6819/1255269393","cluster_addr":"10.20.193.78:6821/1255269393","heartbeat_back_addr":"10.20.193.78:6825/1255269393","heartbeat_front_addr":"10.20.193.78:6823/1255269393","state":["exists","up"]},{"osd":7,"uuid":"b26572df-8730-4245-996e-9f6ad280cd39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6817","nonce":3280635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6819","nonce":3280635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6823","nonce":3280635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6821","nonce":3280635476}]},"public_addr":"10.20.193.91:6817/3280635476","cluster_addr":"10.20.193.91:6819/3280635476","heartbeat_back_addr":"10.20.193.91:6823/3280635476","heartbeat_front_addr":"10.20.193.91:6821/3280635476","state":["exists","up"]},{"osd":8,"uuid":"87ca52a3-dbf2-4405-b992-876c1a7287a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6817","nonce":1767687637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6819","nonce":1767687637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6823","nonce":1767687637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6821","nonce":1767687637}]},"public_addr":"10.20.193.154:6817/1767687637","cluster_addr":"10.20.193.154:6819/1767687637","heartbeat_back_addr":"10.20.193.154:6823/1767687637","heartbeat_front_addr":"10.20.193.154:6821/1767687637","state":["exists","up"]},{"osd":9,"uuid":"771bc3b1-5e53-408b-a87c-9e9a2174df76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6827","nonce":4211100741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6829","nonce":4211100741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6833","nonce":4211100741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6831","nonce":4211100741}]},"public_addr":"10.20.193.78:6827/4211100741","cluster_addr":"10.20.193.78:6829/4211100741","heartbeat_back_addr":"10.20.193.78:6833/4211100741","heartbeat_front_addr":"10.20.193.78:6831/4211100741","state":["exists","up"]},{"osd":10,"uuid":"34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6825","nonce":1302687241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6827","nonce":1302687241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6831","nonce":1302687241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6829","nonce":1302687241}]},"public_addr":"10.20.193.91:6825/1302687241","cluster_addr":"10.20.193.91:6827/1302687241","heartbeat_back_addr":"10.20.193.91:6831/1302687241","heartbeat_front_addr":"10.20.193.91:6829/1302687241","state":["exists","up"]},{"osd":11,"uuid":"28724285-e1a8-4a0f-9b85-fc1a478ddc47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6825","nonce":1149779767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6827","nonce":1149779767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6831","nonce":1149779767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6829","nonce":1149779767}]},"public_addr":"10.20.193.154:6825/1149779767","cluster_addr":"10.20.193.154:6827/1149779767","heartbeat_back_addr":"10.20.193.154:6831/1149779767","heartbeat_front_addr":"10.20.193.154:6829/1149779767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:39:54.522850+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:02.051630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:08.940267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:20.309397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:27.909293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:35.059447+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:46.172446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:53.926260+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:01.093058+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:12.051230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:20.096746+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:27.469090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.78:6801/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6800/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/97242544":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/1589977769":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/3668729280":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/2986039701":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/1592616596":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6801/3975596185":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/2877801719":"2026-02-14T02:39:00.593239+0000","10.20.193.78:6800/3975596185":"2026-02-14T02:39:00.593239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:41:51.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4080b5750 msgr2=0x7ff4080d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4080b5750 0x7ff4080d5c00 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff41c004750 tx=0x7ff41c009390 comp rx=0 tx=0).stop 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff42c116520 msgr2=0x7ff42c121aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff42c116520 0x7ff42c121aa0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff42c055f10 tx=0x7ff42002fce0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 shutdown_connections 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff4080b5750 0x7ff4080d5c00 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff42c126e60 0x7ff42c127300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff42c116520 0x7ff42c121aa0 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 --2- 10.20.193.78:0/3195975242 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff42c1137a0 0x7ff42c121560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.646+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 >> 10.20.193.78:0/3195975242 conn(0x7ff42c061510 msgr2=0x7ff42c114d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:51.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.647+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 shutdown_connections 2026-02-13T02:41:51.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:51.647+0000 7ff4325526c0 1 -- 10.20.193.78:0/3195975242 wait complete. 2026-02-13T02:41:51.756 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:41:51.940 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:51.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:51 trial091 ceph-mon[27614]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T02:41:51.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:51 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2905533559' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T02:41:51.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:51 trial091 ceph-mon[27614]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T02:41:51.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:51 trial091 ceph-mon[27614]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T02:41:52.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:51 trial154 ceph-mon[27921]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T02:41:52.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:51 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2905533559' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T02:41:52.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:51 trial154 ceph-mon[27921]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T02:41:52.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:51 trial154 ceph-mon[27921]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T02:41:52.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 -- 10.20.193.78:0/4110434466 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f038010c6d0 msgr2=0x7f038010dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/4110434466 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f038010c6d0 0x7f038010dda0 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=15601899082870688162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03700099a0 tx=0x7f037002ed00 comp rx=0 tx=0).stop 2026-02-13T02:41:52.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 -- 10.20.193.78:0/4110434466 shutdown_connections 2026-02-13T02:41:52.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/4110434466 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f038010e580 0x7f0380172160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/4110434466 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f038010c6d0 0x7f038010dda0 unknown :-1 s=CLOSED pgs=158 gs=1 cs=0 l=1 c_cookie=15601899082870688162 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/4110434466 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f038010bce0 0x7f038010c0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 -- 10.20.193.78:0/4110434466 >> 10.20.193.78:0/4110434466 conn(0x7f0380063af0 msgr2=0x7f03800642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:52.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 -- 10.20.193.78:0/4110434466 shutdown_connections 2026-02-13T02:41:52.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.144+0000 7f0385fe96c0 1 -- 10.20.193.78:0/4110434466 wait complete. 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 Processor -- start 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 -- start start 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f038010bce0 0x7f03800ee040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f038010e580 0x7f0380172060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f03800ea2a0 0x7f03800ea740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03800eaed0 con 0x7f03800ea2a0 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f03800eb040 con 0x7f038010e580 2026-02-13T02:41:52.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f0385fe96c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0380101430 con 0x7f038010bce0 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f03800ea2a0 0x7f03800ea740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f038010e580 0x7f0380172060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f03800ea2a0 0x7f03800ea740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46680/0 (socket says 10.20.193.78:46680) 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 -- 10.20.193.78:0/3815398525 learned_addr learned my addr 10.20.193.78:0/3815398525 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037f7fe6c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f038010bce0 0x7f03800ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 -- 10.20.193.78:0/3815398525 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f038010bce0 msgr2=0x7f03800ee040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f038010bce0 0x7f03800ee040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 -- 10.20.193.78:0/3815398525 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f038010e580 msgr2=0x7f0380172060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f038010e580 0x7f0380172060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037ffff6c0 1 -- 10.20.193.78:0/3815398525 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0370009590 con 0x7f03800ea2a0 2026-02-13T02:41:52.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.145+0000 7f037f7fe6c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f038010bce0 0x7f03800ee040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.146+0000 7f037ffff6c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f03800ea2a0 0x7f03800ea740 secure :-1 s=READY pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0374006ea0 tx=0x7f037400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.146+0000 7f037cff96c0 1 -- 10.20.193.78:0/3815398525 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0374003a30 con 0x7f03800ea2a0 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.146+0000 7f037cff96c0 1 -- 10.20.193.78:0/3815398525 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0374005510 con 0x7f03800ea2a0 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.146+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0380101710 con 0x7f03800ea2a0 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.146+0000 7f037cff96c0 1 -- 10.20.193.78:0/3815398525 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f037400dd50 con 0x7f03800ea2a0 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.146+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0380101ba0 con 0x7f03800ea2a0 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.146+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03800556c0 con 0x7f03800ea2a0 2026-02-13T02:41:52.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.149+0000 7f037cff96c0 1 -- 10.20.193.78:0/3815398525 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0374003b90 con 0x7f03800ea2a0 2026-02-13T02:41:52.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.151+0000 7f037cff96c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f03540b5650 0x7f03540d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.151+0000 7f037cff96c0 1 -- 10.20.193.78:0/3815398525 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f03740e4b00 con 0x7f03800ea2a0 2026-02-13T02:41:52.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.151+0000 7f037f7fe6c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f03540b5650 0x7f03540d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.151+0000 7f037cff96c0 1 -- 10.20.193.78:0/3815398525 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f037411d5e0 con 0x7f03800ea2a0 2026-02-13T02:41:52.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.151+0000 7f037f7fe6c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f03540b5650 0x7f03540d5b00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f036c005fd0 tx=0x7f036c0092c0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:52.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.252+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03800eb5a0 con 0x7f03800ea2a0 2026-02-13T02:41:52.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.253+0000 7f037cff96c0 1 -- 10.20.193.78:0/3815398525 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22316 (secure 0 0 0) 0x7f03740a75b0 con 0x7f03800ea2a0 2026-02-13T02:41:52.255 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:41:52.255 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":75,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","created":"2026-02-13T02:38:52.551926+0000","modified":"2026-02-13T02:41:51.594154+0000","last_up_change":"2026-02-13T02:41:29.235143+0000","last_in_change":"2026-02-13T02:41:20.987708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:40:11.017308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:41:47.641058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:41:49.198912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4e99f87-c52f-4ab4-9ef0-2fc796b8084f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6803","nonce":2712462435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6805","nonce":2712462435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6809","nonce":2712462435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6807","nonce":2712462435}]},"public_addr":"10.20.193.78:6803/2712462435","cluster_addr":"10.20.193.78:6805/2712462435","heartbeat_back_addr":"10.20.193.78:6809/2712462435","heartbeat_front_addr":"10.20.193.78:6807/2712462435","state":["exists","up"]},{"osd":1,"uuid":"75b41a4c-dddc-4c29-885c-997d3f7212c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6800","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6801","nonce":196768757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6803","nonce":196768757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6807","nonce":196768757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6805","nonce":196768757}]},"public_addr":"10.20.193.91:6801/196768757","cluster_addr":"10.20.193.91:6803/196768757","heartbeat_back_addr":"10.20.193.91:6807/196768757","heartbeat_front_addr":"10.20.193.91:6805/196768757","state":["exists","up"]},{"osd":2,"uuid":"2697034a-905b-4bdb-adb4-4f945060e9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6801","nonce":2640210611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6803","nonce":2640210611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6807","nonce":2640210611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6805","nonce":2640210611}]},"public_addr":"10.20.193.154:6801/2640210611","cluster_addr":"10.20.193.154:6803/2640210611","heartbeat_back_addr":"10.20.193.154:6807/2640210611","heartbeat_front_addr":"10.20.193.154:6805/2640210611","state":["exists","up"]},{"osd":3,"uuid":"520c54bf-23d1-4eee-9bb8-a89711e96784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6811","nonce":71468509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6813","nonce":71468509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6817","nonce":71468509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6815","nonce":71468509}]},"public_addr":"10.20.193.78:6811/71468509","cluster_addr":"10.20.193.78:6813/71468509","heartbeat_back_addr":"10.20.193.78:6817/71468509","heartbeat_front_addr":"10.20.193.78:6815/71468509","state":["exists","up"]},{"osd":4,"uuid":"a4c56acb-cf6d-4fb7-a682-d848d6b2651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6809","nonce":4184387195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6811","nonce":4184387195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6815","nonce":4184387195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6813","nonce":4184387195}]},"public_addr":"10.20.193.91:6809/4184387195","cluster_addr":"10.20.193.91:6811/4184387195","heartbeat_back_addr":"10.20.193.91:6815/4184387195","heartbeat_front_addr":"10.20.193.91:6813/4184387195","state":["exists","up"]},{"osd":5,"uuid":"1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6809","nonce":1052719265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6811","nonce":1052719265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6815","nonce":1052719265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6813","nonce":1052719265}]},"public_addr":"10.20.193.154:6809/1052719265","cluster_addr":"10.20.193.154:6811/1052719265","heartbeat_back_addr":"10.20.193.154:6815/1052719265","heartbeat_front_addr":"10.20.193.154:6813/1052719265","state":["exists","up"]},{"osd":6,"uuid":"0cdd77aa-b764-4477-b092-4863371bead5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6819","nonce":1255269393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6821","nonce":1255269393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6825","nonce":1255269393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6823","nonce":1255269393}]},"public_addr":"10.20.193.78:6819/1255269393","cluster_addr":"10.20.193.78:6821/1255269393","heartbeat_back_addr":"10.20.193.78:6825/1255269393","heartbeat_front_addr":"10.20.193.78:6823/1255269393","state":["exists","up"]},{"osd":7,"uuid":"b26572df-8730-4245-996e-9f6ad280cd39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6817","nonce":3280635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6819","nonce":3280635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6823","nonce":3280635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6821","nonce":3280635476}]},"public_addr":"10.20.193.91:6817/3280635476","cluster_addr":"10.20.193.91:6819/3280635476","heartbeat_back_addr":"10.20.193.91:6823/3280635476","heartbeat_front_addr":"10.20.193.91:6821/3280635476","state":["exists","up"]},{"osd":8,"uuid":"87ca52a3-dbf2-4405-b992-876c1a7287a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6817","nonce":1767687637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6819","nonce":1767687637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6823","nonce":1767687637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6821","nonce":1767687637}]},"public_addr":"10.20.193.154:6817/1767687637","cluster_addr":"10.20.193.154:6819/1767687637","heartbeat_back_addr":"10.20.193.154:6823/1767687637","heartbeat_front_addr":"10.20.193.154:6821/1767687637","state":["exists","up"]},{"osd":9,"uuid":"771bc3b1-5e53-408b-a87c-9e9a2174df76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6827","nonce":4211100741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6829","nonce":4211100741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6833","nonce":4211100741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6831","nonce":4211100741}]},"public_addr":"10.20.193.78:6827/4211100741","cluster_addr":"10.20.193.78:6829/4211100741","heartbeat_back_addr":"10.20.193.78:6833/4211100741","heartbeat_front_addr":"10.20.193.78:6831/4211100741","state":["exists","up"]},{"osd":10,"uuid":"34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6825","nonce":1302687241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6827","nonce":1302687241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6831","nonce":1302687241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6829","nonce":1302687241}]},"public_addr":"10.20.193.91:6825/1302687241","cluster_addr":"10.20.193.91:6827/1302687241","heartbeat_back_addr":"10.20.193.91:6831/1302687241","heartbeat_front_addr":"10.20.193.91:6829/1302687241","state":["exists","up"]},{"osd":11,"uuid":"28724285-e1a8-4a0f-9b85-fc1a478ddc47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6825","nonce":1149779767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6827","nonce":1149779767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6831","nonce":1149779767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6829","nonce":1149779767}]},"public_addr":"10.20.193.154:6825/1149779767","cluster_addr":"10.20.193.154:6827/1149779767","heartbeat_back_addr":"10.20.193.154:6831/1149779767","heartbeat_front_addr":"10.20.193.154:6829/1149779767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:39:54.522850+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:02.051630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:08.940267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:20.309397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:27.909293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:35.059447+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:46.172446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:53.926260+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:01.093058+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:12.051230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:20.096746+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:27.469090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.78:6801/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6800/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/97242544":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/1589977769":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/3668729280":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/2986039701":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/1592616596":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6801/3975596185":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/2877801719":"2026-02-14T02:39:00.593239+0000","10.20.193.78:6800/3975596185":"2026-02-14T02:39:00.593239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:41:52.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f03540b5650 msgr2=0x7f03540d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f03540b5650 0x7f03540d5b00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f036c005fd0 tx=0x7f036c0092c0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f03800ea2a0 msgr2=0x7f03800ea740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f03800ea2a0 0x7f03800ea740 secure :-1 s=READY pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0374006ea0 tx=0x7f037400cca0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 shutdown_connections 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f03540b5650 0x7f03540d5b00 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f03800ea2a0 0x7f03800ea740 unknown :-1 s=CLOSED pgs=159 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f038010e580 0x7f0380172060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 --2- 10.20.193.78:0/3815398525 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f038010bce0 0x7f03800ee040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 >> 10.20.193.78:0/3815398525 conn(0x7f0380063af0 msgr2=0x7f038010cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 shutdown_connections 2026-02-13T02:41:52.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.254+0000 7f0385fe96c0 1 -- 10.20.193.78:0/3815398525 wait complete. 2026-02-13T02:41:52.359 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T02:41:52.547 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:52.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 -- 10.20.193.78:0/157317868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c010fbf0 msgr2=0x7f50c0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 --2- 10.20.193.78:0/157317868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c010fbf0 0x7f50c0114c30 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=11904103604240429109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a80099a0 tx=0x7f50a802ed20 comp rx=0 tx=0).stop 2026-02-13T02:41:52.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 -- 10.20.193.78:0/157317868 shutdown_connections 2026-02-13T02:41:52.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 --2- 10.20.193.78:0/157317868 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50c0115410 0x7f50c0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 --2- 10.20.193.78:0/157317868 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c010fbf0 0x7f50c0114c30 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=11904103604240429109 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 --2- 10.20.193.78:0/157317868 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50c010f200 0x7f50c010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 -- 10.20.193.78:0/157317868 >> 10.20.193.78:0/157317868 conn(0x7f50c00ecb00 msgr2=0x7f50c010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:52.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 -- 10.20.193.78:0/157317868 shutdown_connections 2026-02-13T02:41:52.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.736+0000 7f50c70156c0 1 -- 10.20.193.78:0/157317868 wait complete. 2026-02-13T02:41:52.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 Processor -- start 2026-02-13T02:41:52.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 -- start start 2026-02-13T02:41:52.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50c010f200 0x7f50c00f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50c0115410 0x7f50c0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c00f5140 0x7f50c00fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00f5830 con 0x7f50c00f5140 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00fa950 con 0x7f50c0115410 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c70156c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00fab10 con 0x7f50c010f200 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c55876c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c00f5140 0x7f50c00fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c55876c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c00f5140 0x7f50c00fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46708/0 (socket says 10.20.193.78:46708) 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c55876c0 1 -- 10.20.193.78:0/3824931418 learned_addr learned my addr 10.20.193.78:0/3824931418 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.737+0000 7f50c4d866c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50c010f200 0x7f50c00f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50b7fff6c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50c0115410 0x7f50c0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c55876c0 1 -- 10.20.193.78:0/3824931418 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50c010f200 msgr2=0x7f50c00f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c55876c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50c010f200 0x7f50c00f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c55876c0 1 -- 10.20.193.78:0/3824931418 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50c0115410 msgr2=0x7f50c0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c55876c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50c0115410 0x7f50c0175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c55876c0 1 -- 10.20.193.78:0/3824931418 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a8009590 con 0x7f50c00f5140 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50b7fff6c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50c0115410 0x7f50c0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c55876c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c00f5140 0x7f50c00fa410 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50bc006ea0 tx=0x7f50bc00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50b5ffb6c0 1 -- 10.20.193.78:0/3824931418 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50bc003c40 con 0x7f50c00f5140 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50b5ffb6c0 1 -- 10.20.193.78:0/3824931418 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f50bc003da0 con 0x7f50c00f5140 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50b5ffb6c0 1 -- 10.20.193.78:0/3824931418 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50bc0081c0 con 0x7f50c00f5140 2026-02-13T02:41:52.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c00fadf0 con 0x7f50c00f5140 2026-02-13T02:41:52.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.738+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c00fb280 con 0x7f50c00f5140 2026-02-13T02:41:52.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.739+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c01104d0 con 0x7f50c00f5140 2026-02-13T02:41:52.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.741+0000 7f50b5ffb6c0 1 -- 10.20.193.78:0/3824931418 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f50bc00d590 con 0x7f50c00f5140 2026-02-13T02:41:52.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.743+0000 7f50b5ffb6c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f509c0b56d0 0x7f509c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:52.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.743+0000 7f50b5ffb6c0 1 -- 10.20.193.78:0/3824931418 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f50bc0e4940 con 0x7f50c00f5140 2026-02-13T02:41:52.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.743+0000 7f50c4d866c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f509c0b56d0 0x7f509c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:52.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.743+0000 7f50b5ffb6c0 1 -- 10.20.193.78:0/3824931418 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50bc0e4dc0 con 0x7f50c00f5140 2026-02-13T02:41:52.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.743+0000 7f50c4d866c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f509c0b56d0 0x7f509c0d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b0004750 tx=0x7f50b0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:52.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:52.866+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f50c00f5c60 con 0x7f50c00f5140 2026-02-13T02:41:52.868 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:52 trial078 ceph-mon[22944]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T02:41:52.869 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:52 trial078 ceph-mon[22944]: pgmap v178: 97 pgs: 12 active+clean, 28 creating+peering, 57 unknown; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:52.869 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:52 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3195975242' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:52.869 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:52 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.91:6838/1775632234,v1:10.20.193.91:6839/1775632234] up:active 2026-02-13T02:41:52.869 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:52 trial078 ceph-mon[22944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:52.869 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:52 trial078 ceph-mon[22944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:52.869 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:52 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3815398525' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:52 trial091 ceph-mon[27614]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T02:41:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:52 trial091 ceph-mon[27614]: pgmap v178: 97 pgs: 12 active+clean, 28 creating+peering, 57 unknown; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:52 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3195975242' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:52 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.91:6838/1775632234,v1:10.20.193.91:6839/1775632234] up:active 2026-02-13T02:41:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:52 trial091 ceph-mon[27614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:52 trial091 ceph-mon[27614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:52.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:52 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3815398525' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:52 trial154 ceph-mon[27921]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T02:41:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:52 trial154 ceph-mon[27921]: pgmap v178: 97 pgs: 12 active+clean, 28 creating+peering, 57 unknown; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:41:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:52 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3195975242' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:52 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.91:6838/1775632234,v1:10.20.193.91:6839/1775632234] up:active 2026-02-13T02:41:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:52 trial154 ceph-mon[27921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:52 trial154 ceph-mon[27921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:52 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3815398525' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:41:53.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.608+0000 7f50b5ffb6c0 1 -- 10.20.193.78:0/3824931418 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f50bc0a73f0 con 0x7f50c00f5140 2026-02-13T02:41:53.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f509c0b56d0 msgr2=0x7f509c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:53.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f509c0b56d0 0x7f509c0d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b0004750 tx=0x7f50b0009260 comp rx=0 tx=0).stop 2026-02-13T02:41:53.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c00f5140 msgr2=0x7f50c00fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:53.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c00f5140 0x7f50c00fa410 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50bc006ea0 tx=0x7f50bc00ce50 comp rx=0 tx=0).stop 2026-02-13T02:41:53.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 shutdown_connections 2026-02-13T02:41:53.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f509c0b56d0 0x7f509c0d5b80 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:53.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50c00f5140 0x7f50c00fa410 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:53.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50c0115410 0x7f50c0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:53.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 --2- 10.20.193.78:0/3824931418 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50c010f200 0x7f50c00f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:53.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 >> 10.20.193.78:0/3824931418 conn(0x7f50c00ecb00 msgr2=0x7f50c0113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:53.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 shutdown_connections 2026-02-13T02:41:53.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:53.610+0000 7f50c70156c0 1 -- 10.20.193.78:0/3824931418 wait complete. 2026-02-13T02:41:53.751 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-13T02:41:53.751 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs set cephfs max_mds 5 --yes-i-really-mean-it 2026-02-13T02:41:53.935 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:53 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3824931418' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T02:41:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:53 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3824931418' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T02:41:54.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:53 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3824931418' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T02:41:54.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3951510257 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c10fa50 msgr2=0x7f4d2c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:54.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3951510257 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c10fa50 0x7f4d2c114a90 secure :-1 s=READY pgs=96 gs=1 cs=0 l=1 c_cookie=979538889909283684 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d1c009970 tx=0x7f4d1c02ed10 comp rx=0 tx=0).stop 2026-02-13T02:41:54.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3951510257 shutdown_connections 2026-02-13T02:41:54.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3951510257 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 0x7f4d2c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3951510257 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c10fa50 0x7f4d2c114a90 unknown :-1 s=CLOSED pgs=96 gs=1 cs=0 l=1 c_cookie=979538889909283684 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3951510257 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 0x7f4d2c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3951510257 >> 10.20.193.78:0/3951510257 conn(0x7f4d2c0ec980 msgr2=0x7f4d2c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:54.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3951510257 shutdown_connections 2026-02-13T02:41:54.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.137+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3951510257 wait complete. 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.138+0000 7f4d314af6c0 1 Processor -- start 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.138+0000 7f4d314af6c0 1 -- start start 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d314af6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 0x7f4d2c0f4910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d314af6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 0x7f4d2c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d314af6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c0f4f40 0x7f4d2c0fa210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d314af6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c0f5630 con 0x7f4d2c10f060 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d314af6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c0fa750 con 0x7f4d2c0f4f40 2026-02-13T02:41:54.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d314af6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c0fa910 con 0x7f4d2c115270 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 0x7f4d2c0f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 0x7f4d2c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 0x7f4d2c0f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46730/0 (socket says 10.20.193.78:46730) 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2bfff6c0 1 -- 10.20.193.78:0/3978473249 learned_addr learned my addr 10.20.193.78:0/3978473249 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 0x7f4d2c175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:51848/0 (socket says 10.20.193.78:51848) 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d30cae6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c0f4f40 0x7f4d2c0fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2b7fe6c0 1 -- 10.20.193.78:0/3978473249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c0f4f40 msgr2=0x7f4d2c0fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2b7fe6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c0f4f40 0x7f4d2c0fa210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2b7fe6c0 1 -- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 msgr2=0x7f4d2c0f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2b7fe6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 0x7f4d2c0f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2b7fe6c0 1 -- 10.20.193.78:0/3978473249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c009590 con 0x7f4d2c115270 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.139+0000 7f4d2bfff6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 0x7f4d2c0f4910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.140+0000 7f4d2b7fe6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 0x7f4d2c175b10 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d1c009970 tx=0x7f4d1c02fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.140+0000 7f4d297fa6c0 1 -- 10.20.193.78:0/3978473249 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d1c002ae0 con 0x7f4d2c115270 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.140+0000 7f4d297fa6c0 1 -- 10.20.193.78:0/3978473249 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4d1c0046b0 con 0x7f4d2c115270 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.140+0000 7f4d297fa6c0 1 -- 10.20.193.78:0/3978473249 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d1c037070 con 0x7f4d2c115270 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.140+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2c0fab90 con 0x7f4d2c115270 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.140+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d2c0fafc0 con 0x7f4d2c115270 2026-02-13T02:41:54.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.140+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2c110330 con 0x7f4d2c115270 2026-02-13T02:41:54.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.143+0000 7f4d297fa6c0 1 -- 10.20.193.78:0/3978473249 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f4d1c007260 con 0x7f4d2c115270 2026-02-13T02:41:54.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.144+0000 7f4d297fa6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4d000b56d0 0x7f4d000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:54.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.144+0000 7f4d297fa6c0 1 -- 10.20.193.78:0/3978473249 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f4d1c107a40 con 0x7f4d2c115270 2026-02-13T02:41:54.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.144+0000 7f4d2bfff6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4d000b56d0 0x7f4d000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:54.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.144+0000 7f4d297fa6c0 1 -- 10.20.193.78:0/3978473249 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d1c1405e0 con 0x7f4d2c115270 2026-02-13T02:41:54.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.145+0000 7f4d2bfff6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4d000b56d0 0x7f4d000d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d180095e0 tx=0x7f4d18009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:54.272 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.270+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} v 0) -- 0x7f4d2c10f430 con 0x7f4d2c115270 2026-02-13T02:41:54.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.614+0000 7f4d297fa6c0 1 -- 10.20.193.78:0/3978473249 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]=0 v17) ==== 135+0+0 (secure 0 0 0) 0x7f4d1c0ca4f0 con 0x7f4d2c115270 2026-02-13T02:41:54.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4d000b56d0 msgr2=0x7f4d000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:54.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4d000b56d0 0x7f4d000d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d180095e0 tx=0x7f4d18009260 comp rx=0 tx=0).stop 2026-02-13T02:41:54.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 msgr2=0x7f4d2c175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:54.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 0x7f4d2c175b10 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d1c009970 tx=0x7f4d1c02fc20 comp rx=0 tx=0).stop 2026-02-13T02:41:54.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 shutdown_connections 2026-02-13T02:41:54.619 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4d000b56d0 0x7f4d000d5b80 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4d2c0f4f40 0x7f4d2c0fa210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4d2c115270 0x7f4d2c175b10 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 --2- 10.20.193.78:0/3978473249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d2c10f060 0x7f4d2c0f4910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:54.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.616+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 >> 10.20.193.78:0/3978473249 conn(0x7f4d2c0ec980 msgr2=0x7f4d2c10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:54.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.617+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 shutdown_connections 2026-02-13T02:41:54.620 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:54.617+0000 7f4d314af6c0 1 -- 10.20.193.78:0/3978473249 wait complete. 2026-02-13T02:41:54.722 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T02:41:54.906 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:54 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3824931418' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T02:41:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:54 trial091 ceph-mon[27614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:54 trial091 ceph-mon[27614]: pgmap v179: 97 pgs: 55 active+clean, 28 creating+peering, 14 unknown; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 3 op/s 2026-02-13T02:41:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:54 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3978473249' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:41:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:54 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:41:54.949 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:54 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3824931418' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T02:41:54.949 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:54 trial078 ceph-mon[22944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:54.949 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:54 trial078 ceph-mon[22944]: pgmap v179: 97 pgs: 55 active+clean, 28 creating+peering, 14 unknown; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 3 op/s 2026-02-13T02:41:54.949 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:54 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3978473249' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:41:54.949 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:54 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:41:55.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:54 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3824931418' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T02:41:55.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:54 trial154 ceph-mon[27921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:55.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:54 trial154 ceph-mon[27921]: pgmap v179: 97 pgs: 55 active+clean, 28 creating+peering, 14 unknown; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 3 op/s 2026-02-13T02:41:55.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:54 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3978473249' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:41:55.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:54 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.099+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3857282814 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e3410f060 msgr2=0x7f5e3410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.099+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3857282814 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e3410f060 0x7f5e3410f430 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=17391526754579570106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e280099a0 tx=0x7f5e2802ed00 comp rx=0 tx=0).stop 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3857282814 shutdown_connections 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3857282814 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e34115270 0x7f5e34175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3857282814 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5e3410fa50 0x7f5e34114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3857282814 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e3410f060 0x7f5e3410f430 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=17391526754579570106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3857282814 >> 10.20.193.78:0/3857282814 conn(0x7f5e340ec980 msgr2=0x7f5e3410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:55.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3857282814 shutdown_connections 2026-02-13T02:41:55.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3857282814 wait complete. 2026-02-13T02:41:55.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.100+0000 7f5e38a1b6c0 1 Processor -- start 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e38a1b6c0 1 -- start start 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e38a1b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e3410f060 0x7f5e3411d030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e38a1b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e34115270 0x7f5e3411d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e38a1b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5e34122930 0x7f5e34122dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e38a1b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5e34123340 con 0x7f5e34115270 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e38a1b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5e341234b0 con 0x7f5e34122930 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e38a1b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e34123670 con 0x7f5e3410f060 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e3410f060 0x7f5e3411d030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e325756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e34115270 0x7f5e3411d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:55.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e335776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5e34122930 0x7f5e34122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e3410f060 0x7f5e3411d030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:51870/0 (socket says 10.20.193.78:51870) 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 -- 10.20.193.78:0/3738145424 learned_addr learned my addr 10.20.193.78:0/3738145424 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 -- 10.20.193.78:0/3738145424 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5e34122930 msgr2=0x7f5e34122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5e34122930 0x7f5e34122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 -- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e34115270 msgr2=0x7f5e3411d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e34115270 0x7f5e3411d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.101+0000 7f5e32d766c0 1 -- 10.20.193.78:0/3738145424 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e28009590 con 0x7f5e3410f060 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.102+0000 7f5e32d766c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e3410f060 0x7f5e3411d030 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e28031fd0 tx=0x7f5e280047f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.102+0000 7f5e0bfff6c0 1 -- 10.20.193.78:0/3738145424 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e28002ae0 con 0x7f5e3410f060 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.102+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e34163ac0 con 0x7f5e3410f060 2026-02-13T02:41:55.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.102+0000 7f5e0bfff6c0 1 -- 10.20.193.78:0/3738145424 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5e28002c40 con 0x7f5e3410f060 2026-02-13T02:41:55.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.102+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e34163f40 con 0x7f5e3410f060 2026-02-13T02:41:55.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.102+0000 7f5e0bfff6c0 1 -- 10.20.193.78:0/3738145424 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e280372f0 con 0x7f5e3410f060 2026-02-13T02:41:55.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.102+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e34110330 con 0x7f5e3410f060 2026-02-13T02:41:55.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.105+0000 7f5e0bfff6c0 1 -- 10.20.193.78:0/3738145424 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f5e28007260 con 0x7f5e3410f060 2026-02-13T02:41:55.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.106+0000 7f5e0bfff6c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5e040b56d0 0x7f5e040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:55.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.106+0000 7f5e0bfff6c0 1 -- 10.20.193.78:0/3738145424 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f5e28107ba0 con 0x7f5e3410f060 2026-02-13T02:41:55.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.106+0000 7f5e325756c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5e040b56d0 0x7f5e040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:55.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.107+0000 7f5e0bfff6c0 1 -- 10.20.193.78:0/3738145424 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5e28140600 con 0x7f5e3410f060 2026-02-13T02:41:55.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.107+0000 7f5e325756c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5e040b56d0 0x7f5e040d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e341239c0 tx=0x7f5e1c0093f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:55.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.230+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f5e3410f430 con 0x7f5e3410f060 2026-02-13T02:41:55.622 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.620+0000 7f5e0bfff6c0 1 -- 10.20.193.78:0/3738145424 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f5e280ca650 con 0x7f5e3410f060 2026-02-13T02:41:55.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.622+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5e040b56d0 msgr2=0x7f5e040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.622+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5e040b56d0 0x7f5e040d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e341239c0 tx=0x7f5e1c0093f0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.622+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e3410f060 msgr2=0x7f5e3411d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.622+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e3410f060 0x7f5e3411d030 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e28031fd0 tx=0x7f5e280047f0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 shutdown_connections 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5e040b56d0 0x7f5e040d5b80 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5e34122930 0x7f5e34122dd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5e34115270 0x7f5e3411d570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 --2- 10.20.193.78:0/3738145424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5e3410f060 0x7f5e3411d030 unknown :-1 s=CLOSED pgs=91 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 >> 10.20.193.78:0/3738145424 conn(0x7f5e340ec980 msgr2=0x7f5e3410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:55.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 shutdown_connections 2026-02-13T02:41:55.626 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:55.623+0000 7f5e38a1b6c0 1 -- 10.20.193.78:0/3738145424 wait complete. 2026-02-13T02:41:55.726 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T02:41:55.908 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:55.945 INFO:journalctl@ceph.mds.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-b[56883]: 2026-02-13T02:41:55.585+0000 7f48491016c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T02:41:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T02:41:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:41:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T02:41:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2026-02-13T02:41:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: daemon mds.a is now active in filesystem cephfs as rank 1 2026-02-13T02:41:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3738145424' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:41:55.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:55 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:41:55.951 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T02:41:55.951 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:41:55.951 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T02:41:55.951 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:55.951 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2026-02-13T02:41:55.951 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: daemon mds.a is now active in filesystem cephfs as rank 1 2026-02-13T02:41:55.952 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3738145424' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:41:55.952 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:55 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: daemon mds.a is now active in filesystem cephfs as rank 1 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3738145424' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:41:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:55 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:41:56.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 -- 10.20.193.78:0/3270639313 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c115410 msgr2=0x7ff04c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:56.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/3270639313 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c115410 0x7ff04c175db0 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=9366922512104671929 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff04800aa70 tx=0x7ff04802fde0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 -- 10.20.193.78:0/3270639313 shutdown_connections 2026-02-13T02:41:56.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/3270639313 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c115410 0x7ff04c175db0 unknown :-1 s=CLOSED pgs=163 gs=3 cs=0 l=1 c_cookie=9366922512104671929 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/3270639313 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff04c10fbf0 0x7ff04c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/3270639313 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff04c10f200 0x7ff04c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 -- 10.20.193.78:0/3270639313 >> 10.20.193.78:0/3270639313 conn(0x7ff04c0ecb00 msgr2=0x7ff04c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 -- 10.20.193.78:0/3270639313 shutdown_connections 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.104+0000 7ff052fa86c0 1 -- 10.20.193.78:0/3270639313 wait complete. 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 Processor -- start 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 -- start start 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c10f200 0x7ff04c11d0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff04c115410 0x7ff04c11d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff04c1229f0 0x7ff04c122e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c123400 con 0x7ff04c10f200 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c123570 con 0x7ff04c115410 2026-02-13T02:41:56.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff052fa86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c123730 con 0x7ff04c1229f0 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff050d1d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c10f200 0x7ff04c11d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff050d1d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c10f200 0x7ff04c11d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55056/0 (socket says 10.20.193.78:55056) 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff050d1d6c0 1 -- 10.20.193.78:0/1227176491 learned_addr learned my addr 10.20.193.78:0/1227176491 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff043fff6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff04c115410 0x7ff04c11d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.105+0000 7ff05151e6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff04c1229f0 0x7ff04c122e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff050d1d6c0 1 -- 10.20.193.78:0/1227176491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff04c1229f0 msgr2=0x7ff04c122e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff050d1d6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff04c1229f0 0x7ff04c122e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff050d1d6c0 1 -- 10.20.193.78:0/1227176491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff04c115410 msgr2=0x7ff04c11d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff050d1d6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff04c115410 0x7ff04c11d630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff050d1d6c0 1 -- 10.20.193.78:0/1227176491 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0340094c0 con 0x7ff04c10f200 2026-02-13T02:41:56.110 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff050d1d6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c10f200 0x7ff04c11d0f0 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff03c009490 tx=0x7ff03c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:56.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff041ffb6c0 1 -- 10.20.193.78:0/1227176491 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff03c004a80 con 0x7ff04c10f200 2026-02-13T02:41:56.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff041ffb6c0 1 -- 10.20.193.78:0/1227176491 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff03c009030 con 0x7ff04c10f200 2026-02-13T02:41:56.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff041ffb6c0 1 -- 10.20.193.78:0/1227176491 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff03c00ce50 con 0x7ff04c10f200 2026-02-13T02:41:56.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04800a660 con 0x7ff04c10f200 2026-02-13T02:41:56.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.106+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c163ee0 con 0x7ff04c10f200 2026-02-13T02:41:56.111 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.107+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04c1104d0 con 0x7ff04c10f200 2026-02-13T02:41:56.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.109+0000 7ff041ffb6c0 1 -- 10.20.193.78:0/1227176491 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff03c0026b0 con 0x7ff04c10f200 2026-02-13T02:41:56.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.111+0000 7ff041ffb6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff0280b56d0 0x7ff0280d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:56.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.111+0000 7ff041ffb6c0 1 -- 10.20.193.78:0/1227176491 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7ff03c0e3a80 con 0x7ff04c10f200 2026-02-13T02:41:56.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.111+0000 7ff043fff6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff0280b56d0 0x7ff0280d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:56.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.111+0000 7ff041ffb6c0 1 -- 10.20.193.78:0/1227176491 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff03c11c5e0 con 0x7ff04c10f200 2026-02-13T02:41:56.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.111+0000 7ff043fff6c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff0280b56d0 0x7ff0280d5b80 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff04c123a80 tx=0x7ff034009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:56.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.236+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff04c163b80 con 0x7ff04c10f200 2026-02-13T02:41:56.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.627+0000 7ff041ffb6c0 1 -- 10.20.193.78:0/1227176491 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7ff03c0a6530 con 0x7ff04c10f200 2026-02-13T02:41:56.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff0280b56d0 msgr2=0x7ff0280d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:56.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff0280b56d0 0x7ff0280d5b80 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff04c123a80 tx=0x7ff034009260 comp rx=0 tx=0).stop 2026-02-13T02:41:56.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c10f200 msgr2=0x7ff04c11d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:56.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c10f200 0x7ff04c11d0f0 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff03c009490 tx=0x7ff03c00bc50 comp rx=0 tx=0).stop 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 shutdown_connections 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff0280b56d0 0x7ff0280d5b80 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff04c1229f0 0x7ff04c122e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff04c115410 0x7ff04c11d630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 --2- 10.20.193.78:0/1227176491 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff04c10f200 0x7ff04c11d0f0 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 >> 10.20.193.78:0/1227176491 conn(0x7ff04c0ecb00 msgr2=0x7ff04c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.629+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 shutdown_connections 2026-02-13T02:41:56.632 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:56.630+0000 7ff052fa86c0 1 -- 10.20.193.78:0/1227176491 wait complete. 2026-02-13T02:41:56.735 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2026-02-13T02:41:56.735 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T02:41:56.917 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: pgmap v180: 97 pgs: 97 active+clean; 579 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s wr, 7 op/s 2026-02-13T02:41:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T02:41:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.78:6840/2991369082,v1:10.20.193.78:6841/2991369082] up:active 2026-02-13T02:41:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T02:41:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2026-02-13T02:41:56.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2026-02-13T02:41:56.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-13T02:41:56.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:56 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1227176491' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T02:41:56.959 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: pgmap v180: 97 pgs: 97 active+clean; 579 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s wr, 7 op/s 2026-02-13T02:41:56.959 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T02:41:56.959 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.78:6840/2991369082,v1:10.20.193.78:6841/2991369082] up:active 2026-02-13T02:41:56.959 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T02:41:56.959 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2026-02-13T02:41:56.959 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2026-02-13T02:41:56.960 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-13T02:41:56.960 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:56 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1227176491' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T02:41:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: pgmap v180: 97 pgs: 97 active+clean; 579 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s wr, 7 op/s 2026-02-13T02:41:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T02:41:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.78:6840/2991369082,v1:10.20.193.78:6841/2991369082] up:active 2026-02-13T02:41:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T02:41:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2026-02-13T02:41:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2026-02-13T02:41:57.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-13T02:41:57.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:56 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1227176491' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T02:41:57.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 -- 10.20.193.78:0/2077129688 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f255410f060 msgr2=0x7f255410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:57.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/2077129688 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f255410f060 0x7f255410f430 secure :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=9375437510316371437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25480099a0 tx=0x7f254802ed20 comp rx=0 tx=0).stop 2026-02-13T02:41:57.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 -- 10.20.193.78:0/2077129688 shutdown_connections 2026-02-13T02:41:57.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/2077129688 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2554115270 0x7f2554175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/2077129688 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f255410fa50 0x7f2554114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/2077129688 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f255410f060 0x7f255410f430 unknown :-1 s=CLOSED pgs=165 gs=1 cs=0 l=1 c_cookie=9375437510316371437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 -- 10.20.193.78:0/2077129688 >> 10.20.193.78:0/2077129688 conn(0x7f25540ec980 msgr2=0x7f255410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:57.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 -- 10.20.193.78:0/2077129688 shutdown_connections 2026-02-13T02:41:57.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.110+0000 7f2553fff6c0 1 -- 10.20.193.78:0/2077129688 wait complete. 2026-02-13T02:41:57.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.111+0000 7f2553fff6c0 1 Processor -- start 2026-02-13T02:41:57.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.111+0000 7f2553fff6c0 1 -- start start 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f2553fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f255410f060 0x7f255411cfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f2553fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2554115270 0x7f255411d500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f2553fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f25541228c0 0x7f2554122d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f2553fff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f25541232d0 con 0x7f25541228c0 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f2553fff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2554123440 con 0x7f255410f060 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f2553fff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2554123600 con 0x7f2554115270 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f25541228c0 0x7f2554122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f25541228c0 0x7f2554122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55066/0 (socket says 10.20.193.78:55066) 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 -- 10.20.193.78:0/4065595258 learned_addr learned my addr 10.20.193.78:0/4065595258 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25527fc6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2554115270 0x7f255411d500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:57.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f2552ffd6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f255410f060 0x7f255411cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 -- 10.20.193.78:0/4065595258 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2554115270 msgr2=0x7f255411d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2554115270 0x7f255411d500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 -- 10.20.193.78:0/4065595258 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f255410f060 msgr2=0x7f255411cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f255410f060 0x7f255411cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 -- 10.20.193.78:0/4065595258 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2548009590 con 0x7f25541228c0 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25527fc6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2554115270 0x7f255411d500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25537fe6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f25541228c0 0x7f2554122d60 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2544006ea0 tx=0x7f254400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25589266c0 1 -- 10.20.193.78:0/4065595258 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2544003c40 con 0x7f25541228c0 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25589266c0 1 -- 10.20.193.78:0/4065595258 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2544003da0 con 0x7f25541228c0 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.112+0000 7f25589266c0 1 -- 10.20.193.78:0/4065595258 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f25440081c0 con 0x7f25541228c0 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.113+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2554163ab0 con 0x7f25541228c0 2026-02-13T02:41:57.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.113+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2554163f40 con 0x7f25541228c0 2026-02-13T02:41:57.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.113+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2554110330 con 0x7f25541228c0 2026-02-13T02:41:57.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.115+0000 7f25589266c0 1 -- 10.20.193.78:0/4065595258 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f254400d590 con 0x7f25541228c0 2026-02-13T02:41:57.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.117+0000 7f25589266c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f25280b56d0 0x7f25280d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:57.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.117+0000 7f25589266c0 1 -- 10.20.193.78:0/4065595258 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f25440e4a90 con 0x7f25541228c0 2026-02-13T02:41:57.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.117+0000 7f2552ffd6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f25280b56d0 0x7f25280d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:57.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.117+0000 7f25589266c0 1 -- 10.20.193.78:0/4065595258 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f254411d5e0 con 0x7f25541228c0 2026-02-13T02:41:57.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.118+0000 7f2552ffd6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f25280b56d0 0x7f25280d5b80 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2548005b40 tx=0x7f25480023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:57.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.250+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f255410fa50 con 0x7f25280b56d0 2026-02-13T02:41:57.630 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:41:57 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:41:57.260+0000 7f04fbd896c0 -1 client.14739 error registering admin socket command: (17) File exists 2026-02-13T02:41:57.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.650+0000 7f25589266c0 1 -- 10.20.193.78:0/4065595258 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f255410fa50 con 0x7f25280b56d0 2026-02-13T02:41:57.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f25280b56d0 msgr2=0x7f25280d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:57.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f25280b56d0 0x7f25280d5b80 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2548005b40 tx=0x7f25480023a0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f25541228c0 msgr2=0x7f2554122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:57.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f25541228c0 0x7f2554122d60 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2544006ea0 tx=0x7f254400ce50 comp rx=0 tx=0).stop 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 shutdown_connections 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f25280b56d0 0x7f25280d5b80 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f25541228c0 0x7f2554122d60 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2554115270 0x7f255411d500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 --2- 10.20.193.78:0/4065595258 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f255410f060 0x7f255411cfc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 >> 10.20.193.78:0/4065595258 conn(0x7f25540ec980 msgr2=0x7f255410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 shutdown_connections 2026-02-13T02:41:57.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:57.653+0000 7f2553fff6c0 1 -- 10.20.193.78:0/4065595258 wait complete. 2026-02-13T02:41:57.761 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T02:41:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:57 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1227176491' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T02:41:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:57 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.91:6836/3322558145,v1:10.20.193.91:6837/3322558145] up:active 2026-02-13T02:41:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:57 trial091 ceph-mon[27614]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T02:41:57.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:57 trial091 ceph-mon[27614]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2026-02-13T02:41:57.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:57 trial091 ceph-mon[27614]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2026-02-13T02:41:57.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:57 trial091 ceph-mon[27614]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-13T02:41:57.948 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:57 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1227176491' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T02:41:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:57 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.91:6836/3322558145,v1:10.20.193.91:6837/3322558145] up:active 2026-02-13T02:41:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:57 trial078 ceph-mon[22944]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T02:41:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:57 trial078 ceph-mon[22944]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2026-02-13T02:41:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:57 trial078 ceph-mon[22944]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2026-02-13T02:41:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:57 trial078 ceph-mon[22944]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-13T02:41:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:57 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1227176491' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T02:41:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:57 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.91:6836/3322558145,v1:10.20.193.91:6837/3322558145] up:active 2026-02-13T02:41:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:57 trial154 ceph-mon[27921]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T02:41:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:57 trial154 ceph-mon[27921]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2026-02-13T02:41:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:57 trial154 ceph-mon[27921]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2026-02-13T02:41:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:57 trial154 ceph-mon[27921]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-13T02:41:58.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 -- 10.20.193.78:0/440538185 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde1810f200 msgr2=0x7fde1810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/440538185 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde1810f200 0x7fde1810f5d0 secure :-1 s=READY pgs=168 gs=1 cs=0 l=1 c_cookie=15715110395426236223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde040099a0 tx=0x7fde0402ed20 comp rx=0 tx=0).stop 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 -- 10.20.193.78:0/440538185 shutdown_connections 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/440538185 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fde18115410 0x7fde18175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/440538185 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fde1810fbf0 0x7fde18114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/440538185 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde1810f200 0x7fde1810f5d0 unknown :-1 s=CLOSED pgs=168 gs=1 cs=0 l=1 c_cookie=15715110395426236223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 -- 10.20.193.78:0/440538185 >> 10.20.193.78:0/440538185 conn(0x7fde180ecb00 msgr2=0x7fde1810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 -- 10.20.193.78:0/440538185 shutdown_connections 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.149+0000 7fde1e5556c0 1 -- 10.20.193.78:0/440538185 wait complete. 2026-02-13T02:41:58.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 Processor -- start 2026-02-13T02:41:58.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 -- start start 2026-02-13T02:41:58.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fde1810f200 0x7fde1811d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde18115410 0x7fde1811d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fde18122b60 0x7fde18123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fde18123570 con 0x7fde18115410 2026-02-13T02:41:58.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fde181236e0 con 0x7fde1810f200 2026-02-13T02:41:58.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1e5556c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde181238a0 con 0x7fde18122b60 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde18115410 0x7fde1811d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde18115410 0x7fde1811d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55118/0 (socket says 10.20.193.78:55118) 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 -- 10.20.193.78:0/3613158897 learned_addr learned my addr 10.20.193.78:0/3613158897 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1cac76c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fde18122b60 0x7fde18123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 -- 10.20.193.78:0/3613158897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fde18122b60 msgr2=0x7fde18123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fde18122b60 0x7fde18123000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 -- 10.20.193.78:0/3613158897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fde1810f200 msgr2=0x7fde1811d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde17fff6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fde1810f200 0x7fde1811d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fde1810f200 0x7fde1811d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde177fe6c0 1 -- 10.20.193.78:0/3613158897 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde04009590 con 0x7fde18115410 2026-02-13T02:41:58.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.150+0000 7fde1cac76c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fde18122b60 0x7fde18123000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde17fff6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fde1810f200 0x7fde1811d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde177fe6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde18115410 0x7fde1811d7a0 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde08005dc0 tx=0x7fde0800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde157fa6c0 1 -- 10.20.193.78:0/3613158897 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde08004250 con 0x7fde18115410 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde157fa6c0 1 -- 10.20.193.78:0/3613158897 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fde08009070 con 0x7fde18115410 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde157fa6c0 1 -- 10.20.193.78:0/3613158897 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fde0800cdc0 con 0x7fde18115410 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde18163d50 con 0x7fde18115410 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde181641e0 con 0x7fde18115410 2026-02-13T02:41:58.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.151+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde181104d0 con 0x7fde18115410 2026-02-13T02:41:58.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.154+0000 7fde157fa6c0 1 -- 10.20.193.78:0/3613158897 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fde080028c0 con 0x7fde18115410 2026-02-13T02:41:58.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.155+0000 7fde157fa6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddec0b56d0 0x7fddec0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.156+0000 7fde157fa6c0 1 -- 10.20.193.78:0/3613158897 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fde080e3aa0 con 0x7fde18115410 2026-02-13T02:41:58.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.156+0000 7fde17fff6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddec0b56d0 0x7fddec0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.156+0000 7fde157fa6c0 1 -- 10.20.193.78:0/3613158897 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fde0811c5e0 con 0x7fde18115410 2026-02-13T02:41:58.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.156+0000 7fde17fff6c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddec0b56d0 0x7fddec0d5b80 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde040098c0 tx=0x7fde04009230 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:58.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.273+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fde1810fbf0 con 0x7fddec0b56d0 2026-02-13T02:41:58.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.288+0000 7fde157fa6c0 1 -- 10.20.193.78:0/3613158897 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fde1810fbf0 con 0x7fddec0b56d0 2026-02-13T02:41:58.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddec0b56d0 msgr2=0x7fddec0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddec0b56d0 0x7fddec0d5b80 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde040098c0 tx=0x7fde04009230 comp rx=0 tx=0).stop 2026-02-13T02:41:58.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde18115410 msgr2=0x7fde1811d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde18115410 0x7fde1811d7a0 secure :-1 s=READY pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde08005dc0 tx=0x7fde0800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 shutdown_connections 2026-02-13T02:41:58.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fddec0b56d0 0x7fddec0d5b80 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fde18122b60 0x7fde18123000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fde18115410 0x7fde1811d7a0 unknown :-1 s=CLOSED pgs=169 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 --2- 10.20.193.78:0/3613158897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fde1810f200 0x7fde1811d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 >> 10.20.193.78:0/3613158897 conn(0x7fde180ecb00 msgr2=0x7fde1810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:58.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 shutdown_connections 2026-02-13T02:41:58.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.290+0000 7fde1e5556c0 1 -- 10.20.193.78:0/3613158897 wait complete. 2026-02-13T02:41:58.399 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T02:41:58.581 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:58.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.779+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/3209516948 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c10f060 msgr2=0x7f9c1c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.779+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/3209516948 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c10f060 0x7f9c1c10f430 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=9759407471018124822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c100099a0 tx=0x7f9c1002ed00 comp rx=0 tx=0).stop 2026-02-13T02:41:58.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.779+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/3209516948 shutdown_connections 2026-02-13T02:41:58.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.779+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/3209516948 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9c1c115270 0x7f9c1c175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.779+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/3209516948 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10fa50 0x7f9c1c114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.779+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/3209516948 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c10f060 0x7f9c1c10f430 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=9759407471018124822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.779+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/3209516948 >> 10.20.193.78:0/3209516948 conn(0x7f9c1c0ec980 msgr2=0x7f9c1c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:58.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.780+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/3209516948 shutdown_connections 2026-02-13T02:41:58.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.780+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/3209516948 wait complete. 2026-02-13T02:41:58.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.780+0000 7f9c1b5776c0 1 Processor -- start 2026-02-13T02:41:58.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1b5776c0 1 -- start start 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1b5776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10f060 0x7f9c1c11cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1b5776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c115270 0x7f9c1c11d530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1b5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9c1c1228f0 0x7f9c1c122d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1b5776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c123300 con 0x7f9c1c10f060 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1b5776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c123470 con 0x7f9c1c1228f0 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1b5776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1c123630 con 0x7f9c1c115270 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10f060 0x7f9c1c11cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10f060 0x7f9c1c11cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55132/0 (socket says 10.20.193.78:55132) 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 -- 10.20.193.78:0/1324768383 learned_addr learned my addr 10.20.193.78:0/1324768383 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c19d746c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c115270 0x7f9c1c11d530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1ad766c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9c1c1228f0 0x7f9c1c122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 -- 10.20.193.78:0/1324768383 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c115270 msgr2=0x7f9c1c11d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c115270 0x7f9c1c11d530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 -- 10.20.193.78:0/1324768383 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9c1c1228f0 msgr2=0x7f9c1c122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9c1c1228f0 0x7f9c1c122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1a5756c0 1 -- 10.20.193.78:0/1324768383 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c040094c0 con 0x7f9c1c10f060 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c1ad766c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9c1c1228f0 0x7f9c1c122d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.781+0000 7f9c19d746c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c115270 0x7f9c1c11d530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.782+0000 7f9c1a5756c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10f060 0x7f9c1c11cff0 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c10031fd0 tx=0x7f9c1002fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:58.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.782+0000 7f9c037fe6c0 1 -- 10.20.193.78:0/1324768383 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c10002ae0 con 0x7f9c1c10f060 2026-02-13T02:41:58.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.782+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c10009590 con 0x7f9c1c10f060 2026-02-13T02:41:58.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.782+0000 7f9c037fe6c0 1 -- 10.20.193.78:0/1324768383 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9c100046b0 con 0x7f9c1c10f060 2026-02-13T02:41:58.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.782+0000 7f9c037fe6c0 1 -- 10.20.193.78:0/1324768383 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c10037520 con 0x7f9c1c10f060 2026-02-13T02:41:58.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.782+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1c163d70 con 0x7f9c1c10f060 2026-02-13T02:41:58.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.783+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1c110330 con 0x7f9c1c10f060 2026-02-13T02:41:58.787 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.784+0000 7f9c037fe6c0 1 -- 10.20.193.78:0/1324768383 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f9c10002cc0 con 0x7f9c1c10f060 2026-02-13T02:41:58.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.786+0000 7f9c037fe6c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9bf40b56d0 0x7f9bf40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:58.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.786+0000 7f9c037fe6c0 1 -- 10.20.193.78:0/1324768383 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9c10107c10 con 0x7f9c1c10f060 2026-02-13T02:41:58.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.786+0000 7f9c037fe6c0 1 -- 10.20.193.78:0/1324768383 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9c10108090 con 0x7f9c1c10f060 2026-02-13T02:41:58.788 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.786+0000 7f9c19d746c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9bf40b56d0 0x7f9bf40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:58.789 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.787+0000 7f9c19d746c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9bf40b56d0 0x7f9bf40d5b80 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c1c123980 tx=0x7f9c04009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:58.906 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.905+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f9c1c11e140 con 0x7f9bf40b56d0 2026-02-13T02:41:58.907 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:58.907 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: pgmap v181: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s wr, 11 op/s 2026-02-13T02:41:58.907 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.154:6838/4001660484,v1:10.20.193.154:6839/4001660484] up:active 2026-02-13T02:41:58.907 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T02:41:58.907 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T02:41:58.907 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 8 up:standby 2026-02-13T02:41:58.908 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T02:41:58.908 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:58 trial078 ceph-mon[22944]: daemon mds.c is now active in filesystem cephfs as rank 4 2026-02-13T02:41:58.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.908+0000 7f9c037fe6c0 1 -- 10.20.193.78:0/1324768383 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9c1c11e140 con 0x7f9bf40b56d0 2026-02-13T02:41:58.910 INFO:teuthology.orchestra.run.trial078.stdout:/volumes/qa/sv_0/f856e66b-3ca1-42e1-8541-14d42fe96eca 2026-02-13T02:41:58.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.909+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9bf40b56d0 msgr2=0x7f9bf40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.909+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9bf40b56d0 0x7f9bf40d5b80 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c1c123980 tx=0x7f9c04009260 comp rx=0 tx=0).stop 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.909+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10f060 msgr2=0x7f9c1c11cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.909+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10f060 0x7f9c1c11cff0 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c10031fd0 tx=0x7f9c1002fc60 comp rx=0 tx=0).stop 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 shutdown_connections 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9bf40b56d0 0x7f9bf40d5b80 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9c1c1228f0 0x7f9c1c122d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9c1c115270 0x7f9c1c11d530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 --2- 10.20.193.78:0/1324768383 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c1c10f060 0x7f9c1c11cff0 unknown :-1 s=CLOSED pgs=170 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 >> 10.20.193.78:0/1324768383 conn(0x7f9c1c0ec980 msgr2=0x7f9c1c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 shutdown_connections 2026-02-13T02:41:58.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:58.910+0000 7f9c1b5776c0 1 -- 10.20.193.78:0/1324768383 wait complete. 2026-02-13T02:41:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: pgmap v181: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s wr, 11 op/s 2026-02-13T02:41:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.154:6838/4001660484,v1:10.20.193.154:6839/4001660484] up:active 2026-02-13T02:41:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T02:41:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T02:41:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 8 up:standby 2026-02-13T02:41:58.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T02:41:58.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:58 trial091 ceph-mon[27614]: daemon mds.c is now active in filesystem cephfs as rank 4 2026-02-13T02:41:59.015 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T02:41:59.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:59.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: pgmap v181: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s wr, 11 op/s 2026-02-13T02:41:59.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.154:6838/4001660484,v1:10.20.193.154:6839/4001660484] up:active 2026-02-13T02:41:59.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T02:41:59.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T02:41:59.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 8 up:standby 2026-02-13T02:41:59.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T02:41:59.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:58 trial154 ceph-mon[27921]: daemon mds.c is now active in filesystem cephfs as rank 4 2026-02-13T02:41:59.199 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:59.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.402+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2754996633 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb530115270 msgr2=0x7fb530175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:59.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.402+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2754996633 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb530115270 0x7fb530175c10 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=6391272061770021724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb52400aa40 tx=0x7fb52402fdf0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.402+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2754996633 shutdown_connections 2026-02-13T02:41:59.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.402+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2754996633 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb530115270 0x7fb530175c10 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=6391272061770021724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.402+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2754996633 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb53010fa50 0x7fb530114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.402+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2754996633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb53010f060 0x7fb53010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.402+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2754996633 >> 10.20.193.78:0/2754996633 conn(0x7fb5300ec980 msgr2=0x7fb53010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:59.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.403+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2754996633 shutdown_connections 2026-02-13T02:41:59.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.403+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2754996633 wait complete. 2026-02-13T02:41:59.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.403+0000 7fb5352c76c0 1 Processor -- start 2026-02-13T02:41:59.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.403+0000 7fb5352c76c0 1 -- start start 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb5352c76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb53010f060 0x7fb530066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb5352c76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb530115270 0x7fb530062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb5352c76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb530062f70 0x7fb530063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb5352c76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb530167870 con 0x7fb530115270 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb5352c76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb53011cc50 con 0x7fb53010f060 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb5352c76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb53011ce10 con 0x7fb530062f70 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb530115270 0x7fb530062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb53010f060 0x7fb530066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb530115270 0x7fb530062990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55152/0 (socket says 10.20.193.78:55152) 2026-02-13T02:41:59.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 -- 10.20.193.78:0/2079072319 learned_addr learned my addr 10.20.193.78:0/2079072319 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb534ac66c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb530062f70 0x7fb530063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 -- 10.20.193.78:0/2079072319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb530062f70 msgr2=0x7fb530063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb530062f70 0x7fb530063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 -- 10.20.193.78:0/2079072319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb53010f060 msgr2=0x7fb530066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb53010f060 0x7fb530066730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 -- 10.20.193.78:0/2079072319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52400a660 con 0x7fb530115270 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52ffff6c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb53010f060 0x7fb530066730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.404+0000 7fb52f7fe6c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb530115270 0x7fb530062990 secure :-1 s=READY pgs=171 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb52000b750 tx=0x7fb52000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.405+0000 7fb52d7fa6c0 1 -- 10.20.193.78:0/2079072319 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb520004a80 con 0x7fb530115270 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.405+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53011d0f0 con 0x7fb530115270 2026-02-13T02:41:59.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.405+0000 7fb52d7fa6c0 1 -- 10.20.193.78:0/2079072319 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb520009030 con 0x7fb530115270 2026-02-13T02:41:59.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.405+0000 7fb52d7fa6c0 1 -- 10.20.193.78:0/2079072319 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb52000cdd0 con 0x7fb530115270 2026-02-13T02:41:59.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.405+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53011d5d0 con 0x7fb530115270 2026-02-13T02:41:59.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.405+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f4005310 con 0x7fb530115270 2026-02-13T02:41:59.410 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.408+0000 7fb52d7fa6c0 1 -- 10.20.193.78:0/2079072319 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb520005000 con 0x7fb530115270 2026-02-13T02:41:59.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.409+0000 7fb52d7fa6c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5040b56d0 0x7fb5040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:41:59.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.409+0000 7fb52d7fa6c0 1 -- 10.20.193.78:0/2079072319 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb5200e38d0 con 0x7fb530115270 2026-02-13T02:41:59.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.409+0000 7fb52ffff6c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5040b56d0 0x7fb5040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:41:59.411 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.409+0000 7fb52d7fa6c0 1 -- 10.20.193.78:0/2079072319 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5200e3d50 con 0x7fb530115270 2026-02-13T02:41:59.412 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.410+0000 7fb52ffff6c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5040b56d0 0x7fb5040d5b80 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb51c004750 tx=0x7fb51c009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:41:59.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.528+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb4f4002bc0 con 0x7fb5040b56d0 2026-02-13T02:41:59.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.544+0000 7fb52d7fa6c0 1 -- 10.20.193.78:0/2079072319 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb4f4002bc0 con 0x7fb5040b56d0 2026-02-13T02:41:59.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.545+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5040b56d0 msgr2=0x7fb5040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.545+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5040b56d0 0x7fb5040d5b80 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb51c004750 tx=0x7fb51c009390 comp rx=0 tx=0).stop 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.545+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb530115270 msgr2=0x7fb530062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.545+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb530115270 0x7fb530062990 secure :-1 s=READY pgs=171 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb52000b750 tx=0x7fb52000bc20 comp rx=0 tx=0).stop 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 shutdown_connections 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb5040b56d0 0x7fb5040d5b80 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb530062f70 0x7fb530063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb530115270 0x7fb530062990 unknown :-1 s=CLOSED pgs=171 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 --2- 10.20.193.78:0/2079072319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb53010f060 0x7fb530066730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 >> 10.20.193.78:0/2079072319 conn(0x7fb5300ec980 msgr2=0x7fb53010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:41:59.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 shutdown_connections 2026-02-13T02:41:59.549 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:41:59.546+0000 7fb5352c76c0 1 -- 10.20.193.78:0/2079072319 wait complete. 2026-02-13T02:41:59.653 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T02:41:59.836 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:41:59.880 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:59 trial078 ceph-mon[22944]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:59.880 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:59 trial078 ceph-mon[22944]: mds.? [v2:10.20.193.154:6836/2809281421,v1:10.20.193.154:6837/2809281421] up:active 2026-02-13T02:41:59.880 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:59 trial078 ceph-mon[22944]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T02:41:59.880 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:41:59 trial078 ceph-mon[22944]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T02:41:59.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:59 trial091 ceph-mon[27614]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:41:59.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:59 trial091 ceph-mon[27614]: mds.? [v2:10.20.193.154:6836/2809281421,v1:10.20.193.154:6837/2809281421] up:active 2026-02-13T02:41:59.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:59 trial091 ceph-mon[27614]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T02:41:59.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:41:59 trial091 ceph-mon[27614]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T02:42:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:59 trial154 ceph-mon[27921]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:59 trial154 ceph-mon[27921]: mds.? [v2:10.20.193.154:6836/2809281421,v1:10.20.193.154:6837/2809281421] up:active 2026-02-13T02:42:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:59 trial154 ceph-mon[27921]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T02:42:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:41:59 trial154 ceph-mon[27921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T02:42:00.034 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/2751019831 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c1410fbf0 msgr2=0x7f7c14114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/2751019831 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c1410fbf0 0x7f7c14114c30 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=12176440845609728321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c040099a0 tx=0x7f7c0402ed00 comp rx=0 tx=0).stop 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/2751019831 shutdown_connections 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/2751019831 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 0x7f7c14175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/2751019831 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c1410fbf0 0x7f7c14114c30 unknown :-1 s=CLOSED pgs=93 gs=2 cs=0 l=1 c_cookie=12176440845609728321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/2751019831 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7c1410f200 0x7f7c1410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/2751019831 >> 10.20.193.78:0/2751019831 conn(0x7f7c140ecb00 msgr2=0x7f7c1410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/2751019831 shutdown_connections 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.032+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/2751019831 wait complete. 2026-02-13T02:42:00.035 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 Processor -- start 2026-02-13T02:42:00.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 -- start start 2026-02-13T02:42:00.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7c1410f200 0x7f7c140f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 0x7f7c14175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c140f5140 0x7f7c140fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c140f5830 con 0x7f7c1410f200 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7c140fa950 con 0x7f7c14115410 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c1aa2c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c140fab10 con 0x7f7c140f5140 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c137fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 0x7f7c14175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c13fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7c1410f200 0x7f7c140f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c137fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 0x7f7c14175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:52820/0 (socket says 10.20.193.78:52820) 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c137fe6c0 1 -- 10.20.193.78:0/637574374 learned_addr learned my addr 10.20.193.78:0/637574374 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.033+0000 7f7c18fa26c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c140f5140 0x7f7c140fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c137fe6c0 1 -- 10.20.193.78:0/637574374 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c140f5140 msgr2=0x7f7c140fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c137fe6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c140f5140 0x7f7c140fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c137fe6c0 1 -- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7c1410f200 msgr2=0x7f7c140f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.038 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c137fe6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7c1410f200 0x7f7c140f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c137fe6c0 1 -- 10.20.193.78:0/637574374 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c04009590 con 0x7f7c14115410 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c137fe6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 0x7f7c14175cb0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c04009290 tx=0x7f7c0402fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c117fa6c0 1 -- 10.20.193.78:0/637574374 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c04002ae0 con 0x7f7c14115410 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c117fa6c0 1 -- 10.20.193.78:0/637574374 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7c040046b0 con 0x7f7c14115410 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c117fa6c0 1 -- 10.20.193.78:0/637574374 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c040372f0 con 0x7f7c14115410 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c140fad90 con 0x7f7c14115410 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.034+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c140fb190 con 0x7f7c14115410 2026-02-13T02:42:00.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.035+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c141104d0 con 0x7f7c14115410 2026-02-13T02:42:00.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.037+0000 7f7c117fa6c0 1 -- 10.20.193.78:0/637574374 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7c04002c40 con 0x7f7c14115410 2026-02-13T02:42:00.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.039+0000 7f7c117fa6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7be80b56e0 0x7f7be80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.039+0000 7f7c117fa6c0 1 -- 10.20.193.78:0/637574374 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f7c04107b90 con 0x7f7c14115410 2026-02-13T02:42:00.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.039+0000 7f7c117fa6c0 1 -- 10.20.193.78:0/637574374 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7c04140600 con 0x7f7c14115410 2026-02-13T02:42:00.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.039+0000 7f7c13fff6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7be80b56e0 0x7f7be80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.040+0000 7f7c13fff6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7be80b56e0 0x7f7be80d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c00004750 tx=0x7f7c00009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:00.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.161+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7c140f5cf0 con 0x7f7be80b56e0 2026-02-13T02:42:00.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.164+0000 7f7c117fa6c0 1 -- 10.20.193.78:0/637574374 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7c000099b0 con 0x7f7be80b56e0 2026-02-13T02:42:00.166 INFO:teuthology.orchestra.run.trial078.stdout:/volumes/qa/sv_1/34d2ce31-90e8-4bcc-8b61-e1296f0ae3c9 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7be80b56e0 msgr2=0x7f7be80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7be80b56e0 0x7f7be80d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c00004750 tx=0x7f7c00009260 comp rx=0 tx=0).stop 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 msgr2=0x7f7c14175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 0x7f7c14175cb0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c04009290 tx=0x7f7c0402fc60 comp rx=0 tx=0).stop 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 shutdown_connections 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f7be80b56e0 0x7f7be80d5b90 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c140f5140 0x7f7c140fa410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c14115410 0x7f7c14175cb0 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 --2- 10.20.193.78:0/637574374 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7c1410f200 0x7f7c140f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 >> 10.20.193.78:0/637574374 conn(0x7f7c140ecb00 msgr2=0x7f7c14113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:00.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 shutdown_connections 2026-02-13T02:42:00.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.165+0000 7f7c1aa2c6c0 1 -- 10.20.193.78:0/637574374 wait complete. 2026-02-13T02:42:00.267 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:42:00.450 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:00.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.644+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/2033277950 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f300622d0 msgr2=0x7f0f300607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.644+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/2033277950 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f300622d0 0x7f0f300607a0 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=9390842448049375004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f240098a0 tx=0x7f0f2402ec40 comp rx=0 tx=0).stop 2026-02-13T02:42:00.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.644+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/2033277950 shutdown_connections 2026-02-13T02:42:00.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.644+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/2033277950 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0f30159910 0x7f0f30179cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.644+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/2033277950 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f30060ce0 0x7f0f30061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.644+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/2033277950 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f300622d0 0x7f0f300607a0 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=9390842448049375004 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.644+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/2033277950 >> 10.20.193.78:0/2033277950 conn(0x7f0f300ea6d0 msgr2=0x7f0f3010aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:00.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.645+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/2033277950 shutdown_connections 2026-02-13T02:42:00.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.645+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/2033277950 wait complete. 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 Processor -- start 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 -- start start 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f30060ce0 0x7f0f300f2040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f300622d0 0x7f0f300f2580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0f30159910 0x7f0f300f7940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0f300f7f90 con 0x7f0f30060ce0 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0f300f8100 con 0x7f0f300622d0 2026-02-13T02:42:00.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2f5776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f300f82c0 con 0x7f0f30159910 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2dd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f300622d0 0x7f0f300f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2dd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f300622d0 0x7f0f300f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:52832/0 (socket says 10.20.193.78:52832) 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2dd746c0 1 -- 10.20.193.78:0/22754784 learned_addr learned my addr 10.20.193.78:0/22754784 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.646+0000 7f0f2e5756c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f30060ce0 0x7f0f300f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2ed766c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0f30159910 0x7f0f300f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2dd746c0 1 -- 10.20.193.78:0/22754784 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0f30159910 msgr2=0x7f0f300f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2dd746c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0f30159910 0x7f0f300f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2dd746c0 1 -- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f30060ce0 msgr2=0x7f0f300f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2dd746c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f30060ce0 0x7f0f300f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2dd746c0 1 -- 10.20.193.78:0/22754784 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f240094c0 con 0x7f0f300622d0 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2dd746c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f300622d0 0x7f0f300f2580 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f18009490 tx=0x7f0f1800bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:00.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f177fe6c0 1 -- 10.20.193.78:0/22754784 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f18004a80 con 0x7f0f300622d0 2026-02-13T02:42:00.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f177fe6c0 1 -- 10.20.193.78:0/22754784 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0f18009030 con 0x7f0f300622d0 2026-02-13T02:42:00.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f300f85a0 con 0x7f0f300622d0 2026-02-13T02:42:00.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f177fe6c0 1 -- 10.20.193.78:0/22754784 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f180071c0 con 0x7f0f300622d0 2026-02-13T02:42:00.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.647+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f300f8c60 con 0x7f0f300622d0 2026-02-13T02:42:00.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.648+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f30061cb0 con 0x7f0f300622d0 2026-02-13T02:42:00.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.650+0000 7f0f177fe6c0 1 -- 10.20.193.78:0/22754784 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0f180026b0 con 0x7f0f300622d0 2026-02-13T02:42:00.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.652+0000 7f0f177fe6c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f080b56e0 0x7f0f080d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:00.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.652+0000 7f0f177fe6c0 1 -- 10.20.193.78:0/22754784 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f0f180e3d40 con 0x7f0f300622d0 2026-02-13T02:42:00.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.652+0000 7f0f177fe6c0 1 -- 10.20.193.78:0/22754784 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0f180a66d0 con 0x7f0f300622d0 2026-02-13T02:42:00.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.652+0000 7f0f2e5756c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f080b56e0 0x7f0f080d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:00.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.652+0000 7f0f2e5756c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f080b56e0 0x7f0f080d5b90 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f240097f0 tx=0x7f0f240023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:00.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.775+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f30061110 con 0x7f0f300622d0 2026-02-13T02:42:00.777 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:00 trial078 ceph-mon[22944]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:00.777 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:00 trial078 ceph-mon[22944]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:00.778 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:00 trial078 ceph-mon[22944]: pgmap v182: 97 pgs: 97 active+clean; 584 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 7.1 KiB/s wr, 23 op/s 2026-02-13T02:42:00.778 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:00 trial078 ceph-mon[22944]: mgrmap e16: x(active, since 2m), standbys: y, z 2026-02-13T02:42:00.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.776+0000 7f0f177fe6c0 1 -- 10.20.193.78:0/22754784 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11993 (secure 0 0 0) 0x7f0f180a9880 con 0x7f0f300622d0 2026-02-13T02:42:00.779 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:00.779 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":26,"btime":"2026-02-13T02:41:58:640395+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14619,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6837/689282216","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":689282216},{"type":"v1","addr":"10.20.193.78:6837","nonce":689282216}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14649,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6839/1269487135","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6838","nonce":1269487135},{"type":"v1","addr":"10.20.193.78:6839","nonce":1269487135}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T02:41:50.210158+0000","modified":"2026-02-13T02:41:58.640391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24692,"mds_1":24673,"mds_2":24656,"mds_3":24655,"mds_4":24643},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24598":{"gid":24598,"name":"l","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.154:6833/3544208376","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3544208376},{"type":"v1","addr":"10.20.193.154:6833","nonce":3544208376}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.91:6833/891371423","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":891371423},{"type":"v1","addr":"10.20.193.91:6833","nonce":891371423}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.78:6835/414968217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":414968217},{"type":"v1","addr":"10.20.193.78:6835","nonce":414968217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24635":{"gid":24635,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.91:6835/2299414444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2299414444},{"type":"v1","addr":"10.20.193.91:6835","nonce":2299414444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.154:6835/361176953","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":361176953},{"type":"v1","addr":"10.20.193.154:6835","nonce":361176953}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"10.20.193.154:6837/2809281421","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":2809281421},{"type":"v1","addr":"10.20.193.154:6837","nonce":2809281421}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24655":{"gid":24655,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":5,"addr":"10.20.193.154:6839/4001660484","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6838","nonce":4001660484},{"type":"v1","addr":"10.20.193.154:6839","nonce":4001660484}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.91:6837/3322558145","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":3322558145},{"type":"v1","addr":"10.20.193.91:6837","nonce":3322558145}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"10.20.193.78:6841/2991369082","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6840","nonce":2991369082},{"type":"v1","addr":"10.20.193.78:6841","nonce":2991369082}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24692":{"gid":24692,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"10.20.193.91:6839/1775632234","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6838","nonce":1775632234},{"type":"v1","addr":"10.20.193.91:6839","nonce":1775632234}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24692,"qdb_cluster":[24692,24673,24655,24656,24643]},"id":1}]} 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:dumped fsmap epoch 26 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f080b56e0 msgr2=0x7f0f080d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f080b56e0 0x7f0f080d5b90 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f240097f0 tx=0x7f0f240023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f300622d0 msgr2=0x7f0f300f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f300622d0 0x7f0f300f2580 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f18009490 tx=0x7f0f1800bca0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 shutdown_connections 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f080b56e0 0x7f0f080d5b90 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0f30159910 0x7f0f300f7940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0f300622d0 0x7f0f300f2580 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 --2- 10.20.193.78:0/22754784 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0f30060ce0 0x7f0f300f2040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:00.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 >> 10.20.193.78:0/22754784 conn(0x7f0f300ea6d0 msgr2=0x7f0f3010ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:00.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 shutdown_connections 2026-02-13T02:42:00.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:00.777+0000 7f0f2f5776c0 1 -- 10.20.193.78:0/22754784 wait complete. 2026-02-13T02:42:00.880 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:42:00.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:00 trial091 ceph-mon[27614]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:00.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:00 trial091 ceph-mon[27614]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:00.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:00 trial091 ceph-mon[27614]: pgmap v182: 97 pgs: 97 active+clean; 584 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 7.1 KiB/s wr, 23 op/s 2026-02-13T02:42:00.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:00 trial091 ceph-mon[27614]: mgrmap e16: x(active, since 2m), standbys: y, z 2026-02-13T02:42:00.946 INFO:journalctl@ceph.mds.b.trial091.stdout:Feb 13 02:42:00 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-b[56883]: 2026-02-13T02:42:00.585+0000 7f48491016c0 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2026-02-13T02:42:00.946 INFO:journalctl@ceph.mds.b.trial091.stdout:Feb 13 02:42:00 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-b[56883]: 2026-02-13T02:42:00.585+0000 7f48491016c0 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2026-02-13T02:42:01.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:00 trial154 ceph-mon[27921]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:01.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:00 trial154 ceph-mon[27921]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:01.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:00 trial154 ceph-mon[27921]: pgmap v182: 97 pgs: 97 active+clean; 584 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 7.1 KiB/s wr, 23 op/s 2026-02-13T02:42:01.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:00 trial154 ceph-mon[27921]: mgrmap e16: x(active, since 2m), standbys: y, z 2026-02-13T02:42:01.065 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 -- 10.20.193.78:0/1516839876 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e0115270 msgr2=0x7f18e0175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 --2- 10.20.193.78:0/1516839876 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e0115270 0x7f18e0175c10 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=7424874842527010781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18d000aa70 tx=0x7f18d002fde0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 -- 10.20.193.78:0/1516839876 shutdown_connections 2026-02-13T02:42:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 --2- 10.20.193.78:0/1516839876 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e0115270 0x7f18e0175c10 unknown :-1 s=CLOSED pgs=173 gs=1 cs=0 l=1 c_cookie=7424874842527010781 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 --2- 10.20.193.78:0/1516839876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e010fa50 0x7f18e0114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 --2- 10.20.193.78:0/1516839876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f18e010f060 0x7f18e010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 -- 10.20.193.78:0/1516839876 >> 10.20.193.78:0/1516839876 conn(0x7f18e00ec980 msgr2=0x7f18e010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:01.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.261+0000 7f18df5776c0 1 -- 10.20.193.78:0/1516839876 shutdown_connections 2026-02-13T02:42:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.262+0000 7f18df5776c0 1 -- 10.20.193.78:0/1516839876 wait complete. 2026-02-13T02:42:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 Processor -- start 2026-02-13T02:42:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 -- start start 2026-02-13T02:42:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e010f060 0x7f18e011cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e0115270 0x7f18e011d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f18e0122860 0x7f18e0122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0123270 con 0x7f18e010f060 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01233e0 con 0x7f18e0122860 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18df5776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01235a0 con 0x7f18e0115270 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18de5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e010f060 0x7f18e011cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18ded766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f18e0122860 0x7f18e0122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18ddd746c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e0115270 0x7f18e011d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18ddd746c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e0115270 0x7f18e011d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:52768/0 (socket says 10.20.193.78:52768) 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18ddd746c0 1 -- 10.20.193.78:0/4056971179 learned_addr learned my addr 10.20.193.78:0/4056971179 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.263+0000 7f18ded766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f18e0122860 0x7f18e0122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:52850/0 (socket says 10.20.193.78:52850) 2026-02-13T02:42:01.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18ddd746c0 1 -- 10.20.193.78:0/4056971179 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f18e0122860 msgr2=0x7f18e0122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18ddd746c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f18e0122860 0x7f18e0122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18ddd746c0 1 -- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e010f060 msgr2=0x7f18e011cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18ddd746c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e010f060 0x7f18e011cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18ddd746c0 1 -- 10.20.193.78:0/4056971179 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d000a660 con 0x7f18e0115270 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18de5756c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e010f060 0x7f18e011cf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18ddd746c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e0115270 0x7f18e011d4a0 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18c800b6c0 tx=0x7f18c800bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18c77fe6c0 1 -- 10.20.193.78:0/4056971179 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18c8004250 con 0x7f18e0115270 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18c77fe6c0 1 -- 10.20.193.78:0/4056971179 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f18c8009070 con 0x7f18e0115270 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18c77fe6c0 1 -- 10.20.193.78:0/4056971179 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18c800cd20 con 0x7f18e0115270 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e0163a50 con 0x7f18e0115270 2026-02-13T02:42:01.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.264+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e0163ee0 con 0x7f18e0115270 2026-02-13T02:42:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.265+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e0110330 con 0x7f18e0115270 2026-02-13T02:42:01.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.267+0000 7f18c77fe6c0 1 -- 10.20.193.78:0/4056971179 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f18c80028c0 con 0x7f18e0115270 2026-02-13T02:42:01.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.269+0000 7f18c77fe6c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f18b80b5760 0x7f18b80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.269+0000 7f18c77fe6c0 1 -- 10.20.193.78:0/4056971179 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f18c80e3b10 con 0x7f18e0115270 2026-02-13T02:42:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.269+0000 7f18c77fe6c0 1 -- 10.20.193.78:0/4056971179 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18c811c5e0 con 0x7f18e0115270 2026-02-13T02:42:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.269+0000 7f18de5756c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f18b80b5760 0x7f18b80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.269+0000 7f18de5756c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f18b80b5760 0x7f18b80d5c10 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18d4004750 tx=0x7f18d4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:01.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.369+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18e010f430 con 0x7f18e0115270 2026-02-13T02:42:01.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.370+0000 7f18c77fe6c0 1 -- 10.20.193.78:0/4056971179 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22316 (secure 0 0 0) 0x7f18c80a6460 con 0x7f18e0115270 2026-02-13T02:42:01.372 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:01.372 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":75,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","created":"2026-02-13T02:38:52.551926+0000","modified":"2026-02-13T02:41:51.594154+0000","last_up_change":"2026-02-13T02:41:29.235143+0000","last_in_change":"2026-02-13T02:41:20.987708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:40:11.017308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:41:47.641058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:41:49.198912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4e99f87-c52f-4ab4-9ef0-2fc796b8084f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6803","nonce":2712462435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6805","nonce":2712462435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6809","nonce":2712462435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6807","nonce":2712462435}]},"public_addr":"10.20.193.78:6803/2712462435","cluster_addr":"10.20.193.78:6805/2712462435","heartbeat_back_addr":"10.20.193.78:6809/2712462435","heartbeat_front_addr":"10.20.193.78:6807/2712462435","state":["exists","up"]},{"osd":1,"uuid":"75b41a4c-dddc-4c29-885c-997d3f7212c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6800","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6801","nonce":196768757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6803","nonce":196768757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6807","nonce":196768757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6805","nonce":196768757}]},"public_addr":"10.20.193.91:6801/196768757","cluster_addr":"10.20.193.91:6803/196768757","heartbeat_back_addr":"10.20.193.91:6807/196768757","heartbeat_front_addr":"10.20.193.91:6805/196768757","state":["exists","up"]},{"osd":2,"uuid":"2697034a-905b-4bdb-adb4-4f945060e9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6801","nonce":2640210611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6803","nonce":2640210611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6807","nonce":2640210611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6805","nonce":2640210611}]},"public_addr":"10.20.193.154:6801/2640210611","cluster_addr":"10.20.193.154:6803/2640210611","heartbeat_back_addr":"10.20.193.154:6807/2640210611","heartbeat_front_addr":"10.20.193.154:6805/2640210611","state":["exists","up"]},{"osd":3,"uuid":"520c54bf-23d1-4eee-9bb8-a89711e96784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6811","nonce":71468509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6813","nonce":71468509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6817","nonce":71468509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6815","nonce":71468509}]},"public_addr":"10.20.193.78:6811/71468509","cluster_addr":"10.20.193.78:6813/71468509","heartbeat_back_addr":"10.20.193.78:6817/71468509","heartbeat_front_addr":"10.20.193.78:6815/71468509","state":["exists","up"]},{"osd":4,"uuid":"a4c56acb-cf6d-4fb7-a682-d848d6b2651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6809","nonce":4184387195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6811","nonce":4184387195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6815","nonce":4184387195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6813","nonce":4184387195}]},"public_addr":"10.20.193.91:6809/4184387195","cluster_addr":"10.20.193.91:6811/4184387195","heartbeat_back_addr":"10.20.193.91:6815/4184387195","heartbeat_front_addr":"10.20.193.91:6813/4184387195","state":["exists","up"]},{"osd":5,"uuid":"1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6809","nonce":1052719265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6811","nonce":1052719265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6815","nonce":1052719265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6813","nonce":1052719265}]},"public_addr":"10.20.193.154:6809/1052719265","cluster_addr":"10.20.193.154:6811/1052719265","heartbeat_back_addr":"10.20.193.154:6815/1052719265","heartbeat_front_addr":"10.20.193.154:6813/1052719265","state":["exists","up"]},{"osd":6,"uuid":"0cdd77aa-b764-4477-b092-4863371bead5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6819","nonce":1255269393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6821","nonce":1255269393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6825","nonce":1255269393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6823","nonce":1255269393}]},"public_addr":"10.20.193.78:6819/1255269393","cluster_addr":"10.20.193.78:6821/1255269393","heartbeat_back_addr":"10.20.193.78:6825/1255269393","heartbeat_front_addr":"10.20.193.78:6823/1255269393","state":["exists","up"]},{"osd":7,"uuid":"b26572df-8730-4245-996e-9f6ad280cd39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6817","nonce":3280635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6819","nonce":3280635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6823","nonce":3280635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6821","nonce":3280635476}]},"public_addr":"10.20.193.91:6817/3280635476","cluster_addr":"10.20.193.91:6819/3280635476","heartbeat_back_addr":"10.20.193.91:6823/3280635476","heartbeat_front_addr":"10.20.193.91:6821/3280635476","state":["exists","up"]},{"osd":8,"uuid":"87ca52a3-dbf2-4405-b992-876c1a7287a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6817","nonce":1767687637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6819","nonce":1767687637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6823","nonce":1767687637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6821","nonce":1767687637}]},"public_addr":"10.20.193.154:6817/1767687637","cluster_addr":"10.20.193.154:6819/1767687637","heartbeat_back_addr":"10.20.193.154:6823/1767687637","heartbeat_front_addr":"10.20.193.154:6821/1767687637","state":["exists","up"]},{"osd":9,"uuid":"771bc3b1-5e53-408b-a87c-9e9a2174df76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6827","nonce":4211100741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6829","nonce":4211100741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6833","nonce":4211100741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6831","nonce":4211100741}]},"public_addr":"10.20.193.78:6827/4211100741","cluster_addr":"10.20.193.78:6829/4211100741","heartbeat_back_addr":"10.20.193.78:6833/4211100741","heartbeat_front_addr":"10.20.193.78:6831/4211100741","state":["exists","up"]},{"osd":10,"uuid":"34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6825","nonce":1302687241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6827","nonce":1302687241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6831","nonce":1302687241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6829","nonce":1302687241}]},"public_addr":"10.20.193.91:6825/1302687241","cluster_addr":"10.20.193.91:6827/1302687241","heartbeat_back_addr":"10.20.193.91:6831/1302687241","heartbeat_front_addr":"10.20.193.91:6829/1302687241","state":["exists","up"]},{"osd":11,"uuid":"28724285-e1a8-4a0f-9b85-fc1a478ddc47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6825","nonce":1149779767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6827","nonce":1149779767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6831","nonce":1149779767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6829","nonce":1149779767}]},"public_addr":"10.20.193.154:6825/1149779767","cluster_addr":"10.20.193.154:6827/1149779767","heartbeat_back_addr":"10.20.193.154:6831/1149779767","heartbeat_front_addr":"10.20.193.154:6829/1149779767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:39:54.522850+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:02.051630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:08.940267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:20.309397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:27.909293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:35.059447+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:46.172446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:53.926260+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:01.093058+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:12.051230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:20.096746+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:27.469090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.78:6801/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6800/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/97242544":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/1589977769":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/3668729280":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/2986039701":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/1592616596":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6801/3975596185":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/2877801719":"2026-02-14T02:39:00.593239+0000","10.20.193.78:6800/3975596185":"2026-02-14T02:39:00.593239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:42:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f18b80b5760 msgr2=0x7f18b80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f18b80b5760 0x7f18b80d5c10 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18d4004750 tx=0x7f18d4009260 comp rx=0 tx=0).stop 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e0115270 msgr2=0x7f18e011d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e0115270 0x7f18e011d4a0 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18c800b6c0 tx=0x7f18c800bb90 comp rx=0 tx=0).stop 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 shutdown_connections 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f18b80b5760 0x7f18b80d5c10 unknown :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f18e0122860 0x7f18e0122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f18e0115270 0x7f18e011d4a0 unknown :-1 s=CLOSED pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 --2- 10.20.193.78:0/4056971179 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f18e010f060 0x7f18e011cf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 >> 10.20.193.78:0/4056971179 conn(0x7f18e00ec980 msgr2=0x7f18e010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 shutdown_connections 2026-02-13T02:42:01.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.371+0000 7f18df5776c0 1 -- 10.20.193.78:0/4056971179 wait complete. 2026-02-13T02:42:01.476 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T02:42:01.476 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:42:01.660 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 -- 10.20.193.78:0/1386876316 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 msgr2=0x7fb4c4175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 --2- 10.20.193.78:0/1386876316 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c4175c10 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=17690914128554050059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4b4006fd0 tx=0x7fb4b402fd30 comp rx=0 tx=0).stop 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 -- 10.20.193.78:0/1386876316 shutdown_connections 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 --2- 10.20.193.78:0/1386876316 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c4175c10 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=17690914128554050059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 --2- 10.20.193.78:0/1386876316 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4c410fa50 0x7fb4c4114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 --2- 10.20.193.78:0/1386876316 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4c410f060 0x7fb4c410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 -- 10.20.193.78:0/1386876316 >> 10.20.193.78:0/1386876316 conn(0x7fb4c40ec980 msgr2=0x7fb4c410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 -- 10.20.193.78:0/1386876316 shutdown_connections 2026-02-13T02:42:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.865+0000 7fb4c895b6c0 1 -- 10.20.193.78:0/1386876316 wait complete. 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 Processor -- start 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 -- start start 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4c410f060 0x7fb4c411cf10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c411d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4c4122810 0x7fb4c4122cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c4123220 con 0x7fb4c4122810 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c4123390 con 0x7fb4c4115270 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.866+0000 7fb4c895b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c4123550 con 0x7fb4c410f060 2026-02-13T02:42:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c411d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c35776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4c4122810 0x7fb4c4122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c411d450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:52870/0 (socket says 10.20.193.78:52870) 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c2d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4c410f060 0x7fb4c411cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 -- 10.20.193.78:0/610276568 learned_addr learned my addr 10.20.193.78:0/610276568 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 -- 10.20.193.78:0/610276568 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4c410f060 msgr2=0x7fb4c411cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4c410f060 0x7fb4c411cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 -- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4c4122810 msgr2=0x7fb4c4122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4c4122810 0x7fb4c4122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 -- 10.20.193.78:0/610276568 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b400a5b0 con 0x7fb4c4115270 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c35776c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4c4122810 0x7fb4c4122cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c25756c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c411d450 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4ac005930 tx=0x7fb4ac00bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:01.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4a3fff6c0 1 -- 10.20.193.78:0/610276568 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4ac004a80 con 0x7fb4c4115270 2026-02-13T02:42:01.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4a3fff6c0 1 -- 10.20.193.78:0/610276568 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4ac009030 con 0x7fb4c4115270 2026-02-13T02:42:01.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4a3fff6c0 1 -- 10.20.193.78:0/610276568 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4ac00cdd0 con 0x7fb4c4115270 2026-02-13T02:42:01.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c895b6c0 1 -- 10.20.193.78:0/610276568 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c4163a00 con 0x7fb4c4115270 2026-02-13T02:42:01.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.867+0000 7fb4c895b6c0 1 -- 10.20.193.78:0/610276568 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c4163e90 con 0x7fb4c4115270 2026-02-13T02:42:01.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.868+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c4110330 con 0x7fb4c4115270 2026-02-13T02:42:01.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.870+0000 7fb4a3fff6c0 1 -- 10.20.193.78:0/610276568 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fb4ac005000 con 0x7fb4c4115270 2026-02-13T02:42:01.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.872+0000 7fb4a3fff6c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4980b5760 0x7fb4980d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:01.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.872+0000 7fb4a3fff6c0 1 -- 10.20.193.78:0/610276568 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb4ac0e3b60 con 0x7fb4c4115270 2026-02-13T02:42:01.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.872+0000 7fb4a3fff6c0 1 -- 10.20.193.78:0/610276568 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb4ac11c5e0 con 0x7fb4c4115270 2026-02-13T02:42:01.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.872+0000 7fb4c2d766c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4980b5760 0x7fb4980d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:01.874 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.873+0000 7fb4c2d766c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4980b5760 0x7fb4980d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4b8004750 tx=0x7fb4b8009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:01 trial091 ceph-mon[27614]: from='client.24791 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:01 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/22754784' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:42:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:01 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4056971179' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:01.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.971+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4c411e060 con 0x7fb4980b5760 2026-02-13T02:42:01.973 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:01 trial078 ceph-mon[22944]: from='client.24791 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:01.974 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:01 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/22754784' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:42:01.974 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:01 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4056971179' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:01.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.975+0000 7fb4a3fff6c0 1 -- 10.20.193.78:0/610276568 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258950 (secure 0 0 0) 0x7fb4c411e060 con 0x7fb4980b5760 2026-02-13T02:42:01.980 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:01.981 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T02:42:01.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4980b5760 msgr2=0x7fb4980d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4980b5760 0x7fb4980d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4b8004750 tx=0x7fb4b8009390 comp rx=0 tx=0).stop 2026-02-13T02:42:01.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 msgr2=0x7fb4c411d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:01.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c411d450 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4ac005930 tx=0x7fb4ac00bc50 comp rx=0 tx=0).stop 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 shutdown_connections 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4980b5760 0x7fb4980d5c10 unknown :-1 s=CLOSED pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4c4122810 0x7fb4c4122cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4c4115270 0x7fb4c411d450 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 --2- 10.20.193.78:0/610276568 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4c410f060 0x7fb4c411cf10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 >> 10.20.193.78:0/610276568 conn(0x7fb4c40ec980 msgr2=0x7fb4c410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 shutdown_connections 2026-02-13T02:42:01.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:01.978+0000 7fb4a1ffb6c0 1 -- 10.20.193.78:0/610276568 wait complete. 2026-02-13T02:42:02.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:01 trial154 ceph-mon[27921]: from='client.24791 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:42:02.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:01 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/22754784' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:42:02.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:01 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4056971179' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:02.081 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2026-02-13T02:42:01.622074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599061,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":389,"num_write_kb":3782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":325,"ondisk_log_size":325,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333628,"kb_used_data":10060,"kb_used_omap":428,"kb_used_meta":322899,"kb_avail":8807704772,"statfs":{"total":9019431321600,"available":9019089686528,"internally_reserved":0,"allocated":10301440,"data_stored":6589115,"data_compressed":114759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":439045,"internal_metadata":330648827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8693,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":200,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.026371"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753798+0000","last_change":"2026-02-13T02:41:50.599914+0000","last_active":"2026-02-13T02:41:51.753798+0000","last_peered":"2026-02-13T02:41:51.753798+0000","last_clean":"2026-02-13T02:41:51.753798+0000","last_became_active":"2026-02-13T02:41:50.599730+0000","last_became_peered":"2026-02-13T02:41:50.599730+0000","last_unstale":"2026-02-13T02:41:51.753798+0000","last_undegraded":"2026-02-13T02:41:51.753798+0000","last_fullsized":"2026-02-13T02:41:51.753798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:03:13.109709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756660+0000","last_change":"2026-02-13T02:41:50.600052+0000","last_active":"2026-02-13T02:41:51.756660+0000","last_peered":"2026-02-13T02:41:51.756660+0000","last_clean":"2026-02-13T02:41:51.756660+0000","last_became_active":"2026-02-13T02:41:50.599602+0000","last_became_peered":"2026-02-13T02:41:50.599602+0000","last_unstale":"2026-02-13T02:41:51.756660+0000","last_undegraded":"2026-02-13T02:41:51.756660+0000","last_fullsized":"2026-02-13T02:41:51.756660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:52.030776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756493+0000","last_change":"2026-02-13T02:41:50.603536+0000","last_active":"2026-02-13T02:41:51.756493+0000","last_peered":"2026-02-13T02:41:51.756493+0000","last_clean":"2026-02-13T02:41:51.756493+0000","last_became_active":"2026-02-13T02:41:50.603397+0000","last_became_peered":"2026-02-13T02:41:50.603397+0000","last_unstale":"2026-02-13T02:41:51.756493+0000","last_undegraded":"2026-02-13T02:41:51.756493+0000","last_fullsized":"2026-02-13T02:41:51.756493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:53.008982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.757018+0000","last_change":"2026-02-13T02:41:50.605058+0000","last_active":"2026-02-13T02:41:51.757018+0000","last_peered":"2026-02-13T02:41:51.757018+0000","last_clean":"2026-02-13T02:41:51.757018+0000","last_became_active":"2026-02-13T02:41:50.604762+0000","last_became_peered":"2026-02-13T02:41:50.604762+0000","last_unstale":"2026-02-13T02:41:51.757018+0000","last_undegraded":"2026-02-13T02:41:51.757018+0000","last_fullsized":"2026-02-13T02:41:51.757018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:25.425794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638592+0000","last_change":"2026-02-13T02:41:50.603698+0000","last_active":"2026-02-13T02:41:51.638592+0000","last_peered":"2026-02-13T02:41:51.638592+0000","last_clean":"2026-02-13T02:41:51.638592+0000","last_became_active":"2026-02-13T02:41:50.603555+0000","last_became_peered":"2026-02-13T02:41:50.603555+0000","last_unstale":"2026-02-13T02:41:51.638592+0000","last_undegraded":"2026-02-13T02:41:51.638592+0000","last_fullsized":"2026-02-13T02:41:51.638592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:05.519511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598097+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.598097+0000","last_peered":"2026-02-13T02:41:51.598097+0000","last_clean":"2026-02-13T02:41:51.598097+0000","last_became_active":"2026-02-13T02:41:50.607050+0000","last_became_peered":"2026-02-13T02:41:50.607050+0000","last_unstale":"2026-02-13T02:41:51.598097+0000","last_undegraded":"2026-02-13T02:41:51.598097+0000","last_fullsized":"2026-02-13T02:41:51.598097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:36.348221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685915+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.685915+0000","last_peered":"2026-02-13T02:41:51.685915+0000","last_clean":"2026-02-13T02:41:51.685915+0000","last_became_active":"2026-02-13T02:41:50.607052+0000","last_became_peered":"2026-02-13T02:41:50.607052+0000","last_unstale":"2026-02-13T02:41:51.685915+0000","last_undegraded":"2026-02-13T02:41:51.685915+0000","last_fullsized":"2026-02-13T02:41:51.685915+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:09.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596911+0000","last_change":"2026-02-13T02:41:50.606858+0000","last_active":"2026-02-13T02:41:51.596911+0000","last_peered":"2026-02-13T02:41:51.596911+0000","last_clean":"2026-02-13T02:41:51.596911+0000","last_became_active":"2026-02-13T02:41:50.606045+0000","last_became_peered":"2026-02-13T02:41:50.606045+0000","last_unstale":"2026-02-13T02:41:51.596911+0000","last_undegraded":"2026-02-13T02:41:51.596911+0000","last_fullsized":"2026-02-13T02:41:51.596911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:05.276035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756934+0000","last_change":"2026-02-13T02:41:50.604103+0000","last_active":"2026-02-13T02:41:51.756934+0000","last_peered":"2026-02-13T02:41:51.756934+0000","last_clean":"2026-02-13T02:41:51.756934+0000","last_became_active":"2026-02-13T02:41:50.603863+0000","last_became_peered":"2026-02-13T02:41:50.603863+0000","last_unstale":"2026-02-13T02:41:51.756934+0000","last_undegraded":"2026-02-13T02:41:51.756934+0000","last_fullsized":"2026-02-13T02:41:51.756934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:35:13.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598569+0000","last_change":"2026-02-13T02:41:50.604086+0000","last_active":"2026-02-13T02:41:51.598569+0000","last_peered":"2026-02-13T02:41:51.598569+0000","last_clean":"2026-02-13T02:41:51.598569+0000","last_became_active":"2026-02-13T02:41:50.603680+0000","last_became_peered":"2026-02-13T02:41:50.603680+0000","last_unstale":"2026-02-13T02:41:51.598569+0000","last_undegraded":"2026-02-13T02:41:51.598569+0000","last_fullsized":"2026-02-13T02:41:51.598569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:24:37.164379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686176+0000","last_change":"2026-02-13T02:41:50.605319+0000","last_active":"2026-02-13T02:41:51.686176+0000","last_peered":"2026-02-13T02:41:51.686176+0000","last_clean":"2026-02-13T02:41:51.686176+0000","last_became_active":"2026-02-13T02:41:50.605054+0000","last_became_peered":"2026-02-13T02:41:50.605054+0000","last_unstale":"2026-02-13T02:41:51.686176+0000","last_undegraded":"2026-02-13T02:41:51.686176+0000","last_fullsized":"2026-02-13T02:41:51.686176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:25:10.690555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756968+0000","last_change":"2026-02-13T02:41:50.604779+0000","last_active":"2026-02-13T02:41:51.756968+0000","last_peered":"2026-02-13T02:41:51.756968+0000","last_clean":"2026-02-13T02:41:51.756968+0000","last_became_active":"2026-02-13T02:41:50.604459+0000","last_became_peered":"2026-02-13T02:41:50.604459+0000","last_unstale":"2026-02-13T02:41:51.756968+0000","last_undegraded":"2026-02-13T02:41:51.756968+0000","last_fullsized":"2026-02-13T02:41:51.756968+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:56:44.125622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756288+0000","last_change":"2026-02-13T02:41:50.605422+0000","last_active":"2026-02-13T02:41:51.756288+0000","last_peered":"2026-02-13T02:41:51.756288+0000","last_clean":"2026-02-13T02:41:51.756288+0000","last_became_active":"2026-02-13T02:41:50.605329+0000","last_became_peered":"2026-02-13T02:41:50.605329+0000","last_unstale":"2026-02-13T02:41:51.756288+0000","last_undegraded":"2026-02-13T02:41:51.756288+0000","last_fullsized":"2026-02-13T02:41:51.756288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:16.056010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755988+0000","last_change":"2026-02-13T02:41:50.602168+0000","last_active":"2026-02-13T02:41:51.755988+0000","last_peered":"2026-02-13T02:41:51.755988+0000","last_clean":"2026-02-13T02:41:51.755988+0000","last_became_active":"2026-02-13T02:41:50.601828+0000","last_became_peered":"2026-02-13T02:41:50.601828+0000","last_unstale":"2026-02-13T02:41:51.755988+0000","last_undegraded":"2026-02-13T02:41:51.755988+0000","last_fullsized":"2026-02-13T02:41:51.755988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:44.301005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756057+0000","last_change":"2026-02-13T02:41:50.603578+0000","last_active":"2026-02-13T02:41:51.756057+0000","last_peered":"2026-02-13T02:41:51.756057+0000","last_clean":"2026-02-13T02:41:51.756057+0000","last_became_active":"2026-02-13T02:41:50.603419+0000","last_became_peered":"2026-02-13T02:41:50.603419+0000","last_unstale":"2026-02-13T02:41:51.756057+0000","last_undegraded":"2026-02-13T02:41:51.756057+0000","last_fullsized":"2026-02-13T02:41:51.756057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:51:21.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756604+0000","last_change":"2026-02-13T02:41:50.604104+0000","last_active":"2026-02-13T02:41:51.756604+0000","last_peered":"2026-02-13T02:41:51.756604+0000","last_clean":"2026-02-13T02:41:51.756604+0000","last_became_active":"2026-02-13T02:41:50.603842+0000","last_became_peered":"2026-02-13T02:41:50.603842+0000","last_unstale":"2026-02-13T02:41:51.756604+0000","last_undegraded":"2026-02-13T02:41:51.756604+0000","last_fullsized":"2026-02-13T02:41:51.756604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:39:14.046728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753888+0000","last_change":"2026-02-13T02:41:50.600064+0000","last_active":"2026-02-13T02:41:51.753888+0000","last_peered":"2026-02-13T02:41:51.753888+0000","last_clean":"2026-02-13T02:41:51.753888+0000","last_became_active":"2026-02-13T02:41:50.599816+0000","last_became_peered":"2026-02-13T02:41:50.599816+0000","last_unstale":"2026-02-13T02:41:51.753888+0000","last_undegraded":"2026-02-13T02:41:51.753888+0000","last_fullsized":"2026-02-13T02:41:51.753888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:21.509074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756002+0000","last_change":"2026-02-13T02:41:50.603623+0000","last_active":"2026-02-13T02:41:51.756002+0000","last_peered":"2026-02-13T02:41:51.756002+0000","last_clean":"2026-02-13T02:41:51.756002+0000","last_became_active":"2026-02-13T02:41:50.603557+0000","last_became_peered":"2026-02-13T02:41:50.603557+0000","last_unstale":"2026-02-13T02:41:51.756002+0000","last_undegraded":"2026-02-13T02:41:51.756002+0000","last_fullsized":"2026-02-13T02:41:51.756002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:43.142827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594535+0000","last_change":"2026-02-13T02:41:50.604758+0000","last_active":"2026-02-13T02:41:51.594535+0000","last_peered":"2026-02-13T02:41:51.594535+0000","last_clean":"2026-02-13T02:41:51.594535+0000","last_became_active":"2026-02-13T02:41:50.604617+0000","last_became_peered":"2026-02-13T02:41:50.604617+0000","last_unstale":"2026-02-13T02:41:51.594535+0000","last_undegraded":"2026-02-13T02:41:51.594535+0000","last_fullsized":"2026-02-13T02:41:51.594535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:50.763524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753576+0000","last_change":"2026-02-13T02:41:50.601097+0000","last_active":"2026-02-13T02:41:51.753576+0000","last_peered":"2026-02-13T02:41:51.753576+0000","last_clean":"2026-02-13T02:41:51.753576+0000","last_became_active":"2026-02-13T02:41:50.600904+0000","last_became_peered":"2026-02-13T02:41:50.600904+0000","last_unstale":"2026-02-13T02:41:51.753576+0000","last_undegraded":"2026-02-13T02:41:51.753576+0000","last_fullsized":"2026-02-13T02:41:51.753576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:28:11.088460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756282+0000","last_change":"2026-02-13T02:41:50.610769+0000","last_active":"2026-02-13T02:41:51.756282+0000","last_peered":"2026-02-13T02:41:51.756282+0000","last_clean":"2026-02-13T02:41:51.756282+0000","last_became_active":"2026-02-13T02:41:50.610617+0000","last_became_peered":"2026-02-13T02:41:50.610617+0000","last_unstale":"2026-02-13T02:41:51.756282+0000","last_undegraded":"2026-02-13T02:41:51.756282+0000","last_fullsized":"2026-02-13T02:41:51.756282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:46.547410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756657+0000","last_change":"2026-02-13T02:41:50.607490+0000","last_active":"2026-02-13T02:41:51.756657+0000","last_peered":"2026-02-13T02:41:51.756657+0000","last_clean":"2026-02-13T02:41:51.756657+0000","last_became_active":"2026-02-13T02:41:50.607298+0000","last_became_peered":"2026-02-13T02:41:50.607298+0000","last_unstale":"2026-02-13T02:41:51.756657+0000","last_undegraded":"2026-02-13T02:41:51.756657+0000","last_fullsized":"2026-02-13T02:41:51.756657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:07.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596921+0000","last_change":"2026-02-13T02:41:50.606974+0000","last_active":"2026-02-13T02:41:51.596921+0000","last_peered":"2026-02-13T02:41:51.596921+0000","last_clean":"2026-02-13T02:41:51.596921+0000","last_became_active":"2026-02-13T02:41:50.606344+0000","last_became_peered":"2026-02-13T02:41:50.606344+0000","last_unstale":"2026-02-13T02:41:51.596921+0000","last_undegraded":"2026-02-13T02:41:51.596921+0000","last_fullsized":"2026-02-13T02:41:51.596921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:12.593325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594547+0000","last_change":"2026-02-13T02:41:50.605952+0000","last_active":"2026-02-13T02:41:51.594547+0000","last_peered":"2026-02-13T02:41:51.594547+0000","last_clean":"2026-02-13T02:41:51.594547+0000","last_became_active":"2026-02-13T02:41:50.605843+0000","last_became_peered":"2026-02-13T02:41:50.605843+0000","last_unstale":"2026-02-13T02:41:51.594547+0000","last_undegraded":"2026-02-13T02:41:51.594547+0000","last_fullsized":"2026-02-13T02:41:51.594547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:43:56.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597412+0000","last_change":"2026-02-13T02:41:50.607967+0000","last_active":"2026-02-13T02:41:51.597412+0000","last_peered":"2026-02-13T02:41:51.597412+0000","last_clean":"2026-02-13T02:41:51.597412+0000","last_became_active":"2026-02-13T02:41:50.607467+0000","last_became_peered":"2026-02-13T02:41:50.607467+0000","last_unstale":"2026-02-13T02:41:51.597412+0000","last_undegraded":"2026-02-13T02:41:51.597412+0000","last_fullsized":"2026-02-13T02:41:51.597412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:02.579210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594625+0000","last_change":"2026-02-13T02:41:50.599821+0000","last_active":"2026-02-13T02:41:51.594625+0000","last_peered":"2026-02-13T02:41:51.594625+0000","last_clean":"2026-02-13T02:41:51.594625+0000","last_became_active":"2026-02-13T02:41:50.599654+0000","last_became_peered":"2026-02-13T02:41:50.599654+0000","last_unstale":"2026-02-13T02:41:51.594625+0000","last_undegraded":"2026-02-13T02:41:51.594625+0000","last_fullsized":"2026-02-13T02:41:51.594625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:32:20.138295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753717+0000","last_change":"2026-02-13T02:41:50.600422+0000","last_active":"2026-02-13T02:41:51.753717+0000","last_peered":"2026-02-13T02:41:51.753717+0000","last_clean":"2026-02-13T02:41:51.753717+0000","last_became_active":"2026-02-13T02:41:50.600118+0000","last_became_peered":"2026-02-13T02:41:50.600118+0000","last_unstale":"2026-02-13T02:41:51.753717+0000","last_undegraded":"2026-02-13T02:41:51.753717+0000","last_fullsized":"2026-02-13T02:41:51.753717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:18:51.209188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756265+0000","last_change":"2026-02-13T02:41:50.611343+0000","last_active":"2026-02-13T02:41:51.756265+0000","last_peered":"2026-02-13T02:41:51.756265+0000","last_clean":"2026-02-13T02:41:51.756265+0000","last_became_active":"2026-02-13T02:41:50.611129+0000","last_became_peered":"2026-02-13T02:41:50.611129+0000","last_unstale":"2026-02-13T02:41:51.756265+0000","last_undegraded":"2026-02-13T02:41:51.756265+0000","last_fullsized":"2026-02-13T02:41:51.756265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:26.181721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756482+0000","last_change":"2026-02-13T02:41:50.610427+0000","last_active":"2026-02-13T02:41:51.756482+0000","last_peered":"2026-02-13T02:41:51.756482+0000","last_clean":"2026-02-13T02:41:51.756482+0000","last_became_active":"2026-02-13T02:41:50.609859+0000","last_became_peered":"2026-02-13T02:41:50.609859+0000","last_unstale":"2026-02-13T02:41:51.756482+0000","last_undegraded":"2026-02-13T02:41:51.756482+0000","last_fullsized":"2026-02-13T02:41:51.756482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:35:38.289372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594356+0000","last_change":"2026-02-13T02:41:50.606399+0000","last_active":"2026-02-13T02:41:51.594356+0000","last_peered":"2026-02-13T02:41:51.594356+0000","last_clean":"2026-02-13T02:41:51.594356+0000","last_became_active":"2026-02-13T02:41:50.606261+0000","last_became_peered":"2026-02-13T02:41:50.606261+0000","last_unstale":"2026-02-13T02:41:51.594356+0000","last_undegraded":"2026-02-13T02:41:51.594356+0000","last_fullsized":"2026-02-13T02:41:51.594356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:35.087843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594337+0000","last_change":"2026-02-13T02:41:50.600540+0000","last_active":"2026-02-13T02:41:51.594337+0000","last_peered":"2026-02-13T02:41:51.594337+0000","last_clean":"2026-02-13T02:41:51.594337+0000","last_became_active":"2026-02-13T02:41:50.600370+0000","last_became_peered":"2026-02-13T02:41:50.600370+0000","last_unstale":"2026-02-13T02:41:51.594337+0000","last_undegraded":"2026-02-13T02:41:51.594337+0000","last_fullsized":"2026-02-13T02:41:51.594337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:42.274036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753590+0000","last_change":"2026-02-13T02:41:50.602084+0000","last_active":"2026-02-13T02:41:51.753590+0000","last_peered":"2026-02-13T02:41:51.753590+0000","last_clean":"2026-02-13T02:41:51.753590+0000","last_became_active":"2026-02-13T02:41:50.601938+0000","last_became_peered":"2026-02-13T02:41:50.601938+0000","last_unstale":"2026-02-13T02:41:51.753590+0000","last_undegraded":"2026-02-13T02:41:51.753590+0000","last_fullsized":"2026-02-13T02:41:51.753590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:12:44.963129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638688+0000","last_change":"2026-02-13T02:41:50.602908+0000","last_active":"2026-02-13T02:41:51.638688+0000","last_peered":"2026-02-13T02:41:51.638688+0000","last_clean":"2026-02-13T02:41:51.638688+0000","last_became_active":"2026-02-13T02:41:50.602815+0000","last_became_peered":"2026-02-13T02:41:50.602815+0000","last_unstale":"2026-02-13T02:41:51.638688+0000","last_undegraded":"2026-02-13T02:41:51.638688+0000","last_fullsized":"2026-02-13T02:41:51.638688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:51:10.405979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621683+0000","last_change":"2026-02-13T02:41:49.595741+0000","last_active":"2026-02-13T02:41:54.621683+0000","last_peered":"2026-02-13T02:41:54.621683+0000","last_clean":"2026-02-13T02:41:54.621683+0000","last_became_active":"2026-02-13T02:41:49.595588+0000","last_became_peered":"2026-02-13T02:41:49.595588+0000","last_unstale":"2026-02-13T02:41:54.621683+0000","last_undegraded":"2026-02-13T02:41:54.621683+0000","last_fullsized":"2026-02-13T02:41:54.621683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:16.074126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594578+0000","last_change":"2026-02-13T02:41:50.604001+0000","last_active":"2026-02-13T02:41:51.594578+0000","last_peered":"2026-02-13T02:41:51.594578+0000","last_clean":"2026-02-13T02:41:51.594578+0000","last_became_active":"2026-02-13T02:41:50.603876+0000","last_became_peered":"2026-02-13T02:41:50.603876+0000","last_unstale":"2026-02-13T02:41:51.594578+0000","last_undegraded":"2026-02-13T02:41:51.594578+0000","last_fullsized":"2026-02-13T02:41:51.594578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:24:01.725748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.636482+0000","last_change":"2026-02-13T02:41:49.604405+0000","last_active":"2026-02-13T02:41:56.636482+0000","last_peered":"2026-02-13T02:41:56.636482+0000","last_clean":"2026-02-13T02:41:56.636482+0000","last_became_active":"2026-02-13T02:41:49.604257+0000","last_became_peered":"2026-02-13T02:41:49.604257+0000","last_unstale":"2026-02-13T02:41:56.636482+0000","last_undegraded":"2026-02-13T02:41:56.636482+0000","last_fullsized":"2026-02-13T02:41:56.636482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:45.835163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.630743+0000","last_change":"2026-02-13T02:41:49.601797+0000","last_active":"2026-02-13T02:41:55.630743+0000","last_peered":"2026-02-13T02:41:55.630743+0000","last_clean":"2026-02-13T02:41:55.630743+0000","last_became_active":"2026-02-13T02:41:49.601398+0000","last_became_peered":"2026-02-13T02:41:49.601398+0000","last_unstale":"2026-02-13T02:41:55.630743+0000","last_undegraded":"2026-02-13T02:41:55.630743+0000","last_fullsized":"2026-02-13T02:41:55.630743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:37.346955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596989+0000","last_change":"2026-02-13T02:41:50.606972+0000","last_active":"2026-02-13T02:41:51.596989+0000","last_peered":"2026-02-13T02:41:51.596989+0000","last_clean":"2026-02-13T02:41:51.596989+0000","last_became_active":"2026-02-13T02:41:50.606736+0000","last_became_peered":"2026-02-13T02:41:50.606736+0000","last_unstale":"2026-02-13T02:41:51.596989+0000","last_undegraded":"2026-02-13T02:41:51.596989+0000","last_fullsized":"2026-02-13T02:41:51.596989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:46.423039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621337+0000","last_change":"2026-02-13T02:41:49.595837+0000","last_active":"2026-02-13T02:41:54.621337+0000","last_peered":"2026-02-13T02:41:54.621337+0000","last_clean":"2026-02-13T02:41:54.621337+0000","last_became_active":"2026-02-13T02:41:49.595704+0000","last_became_peered":"2026-02-13T02:41:49.595704+0000","last_unstale":"2026-02-13T02:41:54.621337+0000","last_undegraded":"2026-02-13T02:41:54.621337+0000","last_fullsized":"2026-02-13T02:41:54.621337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:01:23.763609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756049+0000","last_change":"2026-02-13T02:41:50.611914+0000","last_active":"2026-02-13T02:41:51.756049+0000","last_peered":"2026-02-13T02:41:51.756049+0000","last_clean":"2026-02-13T02:41:51.756049+0000","last_became_active":"2026-02-13T02:41:50.611636+0000","last_became_peered":"2026-02-13T02:41:50.611636+0000","last_unstale":"2026-02-13T02:41:51.756049+0000","last_undegraded":"2026-02-13T02:41:51.756049+0000","last_fullsized":"2026-02-13T02:41:51.756049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:52:16.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.626018+0000","last_change":"2026-02-13T02:41:49.601592+0000","last_active":"2026-02-13T02:41:54.626018+0000","last_peered":"2026-02-13T02:41:54.626018+0000","last_clean":"2026-02-13T02:41:54.626018+0000","last_became_active":"2026-02-13T02:41:49.601466+0000","last_became_peered":"2026-02-13T02:41:49.601466+0000","last_unstale":"2026-02-13T02:41:54.626018+0000","last_undegraded":"2026-02-13T02:41:54.626018+0000","last_fullsized":"2026-02-13T02:41:54.626018+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:54.238406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756898+0000","last_change":"2026-02-13T02:41:50.605957+0000","last_active":"2026-02-13T02:41:51.756898+0000","last_peered":"2026-02-13T02:41:51.756898+0000","last_clean":"2026-02-13T02:41:51.756898+0000","last_became_active":"2026-02-13T02:41:50.605827+0000","last_became_peered":"2026-02-13T02:41:50.605827+0000","last_unstale":"2026-02-13T02:41:51.756898+0000","last_undegraded":"2026-02-13T02:41:51.756898+0000","last_fullsized":"2026-02-13T02:41:51.756898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:29.966443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643085+0000","last_change":"2026-02-13T02:41:49.599890+0000","last_active":"2026-02-13T02:41:57.643085+0000","last_peered":"2026-02-13T02:41:57.643085+0000","last_clean":"2026-02-13T02:41:57.643085+0000","last_became_active":"2026-02-13T02:41:49.599626+0000","last_became_peered":"2026-02-13T02:41:49.599626+0000","last_unstale":"2026-02-13T02:41:57.643085+0000","last_undegraded":"2026-02-13T02:41:57.643085+0000","last_fullsized":"2026-02-13T02:41:57.643085+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:27:44.242839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756712+0000","last_change":"2026-02-13T02:41:50.608740+0000","last_active":"2026-02-13T02:41:51.756712+0000","last_peered":"2026-02-13T02:41:51.756712+0000","last_clean":"2026-02-13T02:41:51.756712+0000","last_became_active":"2026-02-13T02:41:50.607195+0000","last_became_peered":"2026-02-13T02:41:50.607195+0000","last_unstale":"2026-02-13T02:41:51.756712+0000","last_undegraded":"2026-02-13T02:41:51.756712+0000","last_fullsized":"2026-02-13T02:41:51.756712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:44.460181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621624+0000","last_change":"2026-02-13T02:41:49.600637+0000","last_active":"2026-02-13T02:41:54.621624+0000","last_peered":"2026-02-13T02:41:54.621624+0000","last_clean":"2026-02-13T02:41:54.621624+0000","last_became_active":"2026-02-13T02:41:49.600502+0000","last_became_peered":"2026-02-13T02:41:49.600502+0000","last_unstale":"2026-02-13T02:41:54.621624+0000","last_undegraded":"2026-02-13T02:41:54.621624+0000","last_fullsized":"2026-02-13T02:41:54.621624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:42:59.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756802+0000","last_change":"2026-02-13T02:41:50.605595+0000","last_active":"2026-02-13T02:41:51.756802+0000","last_peered":"2026-02-13T02:41:51.756802+0000","last_clean":"2026-02-13T02:41:51.756802+0000","last_became_active":"2026-02-13T02:41:50.605404+0000","last_became_peered":"2026-02-13T02:41:50.605404+0000","last_unstale":"2026-02-13T02:41:51.756802+0000","last_undegraded":"2026-02-13T02:41:51.756802+0000","last_fullsized":"2026-02-13T02:41:51.756802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:15.374790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.622321+0000","last_change":"2026-02-13T02:41:49.600871+0000","last_active":"2026-02-13T02:41:54.622321+0000","last_peered":"2026-02-13T02:41:54.622321+0000","last_clean":"2026-02-13T02:41:54.622321+0000","last_became_active":"2026-02-13T02:41:49.600717+0000","last_became_peered":"2026-02-13T02:41:49.600717+0000","last_unstale":"2026-02-13T02:41:54.622321+0000","last_undegraded":"2026-02-13T02:41:54.622321+0000","last_fullsized":"2026-02-13T02:41:54.622321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:03.550683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638813+0000","last_change":"2026-02-13T02:41:50.601869+0000","last_active":"2026-02-13T02:41:51.638813+0000","last_peered":"2026-02-13T02:41:51.638813+0000","last_clean":"2026-02-13T02:41:51.638813+0000","last_became_active":"2026-02-13T02:41:50.601753+0000","last_became_peered":"2026-02-13T02:41:50.601753+0000","last_unstale":"2026-02-13T02:41:51.638813+0000","last_undegraded":"2026-02-13T02:41:51.638813+0000","last_fullsized":"2026-02-13T02:41:51.638813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:53.246854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.626092+0000","last_change":"2026-02-13T02:41:49.605257+0000","last_active":"2026-02-13T02:41:55.626092+0000","last_peered":"2026-02-13T02:41:55.626092+0000","last_clean":"2026-02-13T02:41:55.626092+0000","last_became_active":"2026-02-13T02:41:49.605162+0000","last_became_peered":"2026-02-13T02:41:49.605162+0000","last_unstale":"2026-02-13T02:41:55.626092+0000","last_undegraded":"2026-02-13T02:41:55.626092+0000","last_fullsized":"2026-02-13T02:41:55.626092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:46.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756594+0000","last_change":"2026-02-13T02:41:50.608778+0000","last_active":"2026-02-13T02:41:51.756594+0000","last_peered":"2026-02-13T02:41:51.756594+0000","last_clean":"2026-02-13T02:41:51.756594+0000","last_became_active":"2026-02-13T02:41:50.608686+0000","last_became_peered":"2026-02-13T02:41:50.608686+0000","last_unstale":"2026-02-13T02:41:51.756594+0000","last_undegraded":"2026-02-13T02:41:51.756594+0000","last_fullsized":"2026-02-13T02:41:51.756594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:01.765041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621642+0000","last_change":"2026-02-13T02:41:49.603081+0000","last_active":"2026-02-13T02:41:54.621642+0000","last_peered":"2026-02-13T02:41:54.621642+0000","last_clean":"2026-02-13T02:41:54.621642+0000","last_became_active":"2026-02-13T02:41:49.602818+0000","last_became_peered":"2026-02-13T02:41:49.602818+0000","last_unstale":"2026-02-13T02:41:54.621642+0000","last_undegraded":"2026-02-13T02:41:54.621642+0000","last_fullsized":"2026-02-13T02:41:54.621642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:55.523356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686167+0000","last_change":"2026-02-13T02:41:50.606663+0000","last_active":"2026-02-13T02:41:51.686167+0000","last_peered":"2026-02-13T02:41:51.686167+0000","last_clean":"2026-02-13T02:41:51.686167+0000","last_became_active":"2026-02-13T02:41:50.606460+0000","last_became_peered":"2026-02-13T02:41:50.606460+0000","last_unstale":"2026-02-13T02:41:51.686167+0000","last_undegraded":"2026-02-13T02:41:51.686167+0000","last_fullsized":"2026-02-13T02:41:51.686167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:23:24.744253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.647049+0000","last_change":"2026-02-13T02:41:49.597626+0000","last_active":"2026-02-13T02:41:58.647049+0000","last_peered":"2026-02-13T02:41:58.647049+0000","last_clean":"2026-02-13T02:41:58.647049+0000","last_became_active":"2026-02-13T02:41:49.597177+0000","last_became_peered":"2026-02-13T02:41:49.597177+0000","last_unstale":"2026-02-13T02:41:58.647049+0000","last_undegraded":"2026-02-13T02:41:58.647049+0000","last_fullsized":"2026-02-13T02:41:58.647049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:43.194968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685920+0000","last_change":"2026-02-13T02:41:50.605190+0000","last_active":"2026-02-13T02:41:51.685920+0000","last_peered":"2026-02-13T02:41:51.685920+0000","last_clean":"2026-02-13T02:41:51.685920+0000","last_became_active":"2026-02-13T02:41:50.604929+0000","last_became_peered":"2026-02-13T02:41:50.604929+0000","last_unstale":"2026-02-13T02:41:51.685920+0000","last_undegraded":"2026-02-13T02:41:51.685920+0000","last_fullsized":"2026-02-13T02:41:51.685920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:41:19.216490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639971+0000","last_change":"2026-02-13T02:41:49.597710+0000","last_active":"2026-02-13T02:41:57.639971+0000","last_peered":"2026-02-13T02:41:57.639971+0000","last_clean":"2026-02-13T02:41:57.639971+0000","last_became_active":"2026-02-13T02:41:49.597545+0000","last_became_peered":"2026-02-13T02:41:49.597545+0000","last_unstale":"2026-02-13T02:41:57.639971+0000","last_undegraded":"2026-02-13T02:41:57.639971+0000","last_fullsized":"2026-02-13T02:41:57.639971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:40.978704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594383+0000","last_change":"2026-02-13T02:41:50.602185+0000","last_active":"2026-02-13T02:41:51.594383+0000","last_peered":"2026-02-13T02:41:51.594383+0000","last_clean":"2026-02-13T02:41:51.594383+0000","last_became_active":"2026-02-13T02:41:50.602029+0000","last_became_peered":"2026-02-13T02:41:50.602029+0000","last_unstale":"2026-02-13T02:41:51.594383+0000","last_undegraded":"2026-02-13T02:41:51.594383+0000","last_fullsized":"2026-02-13T02:41:51.594383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:44:46.598780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.624545+0000","last_change":"2026-02-13T02:41:49.596995+0000","last_active":"2026-02-13T02:41:57.624545+0000","last_peered":"2026-02-13T02:41:57.624545+0000","last_clean":"2026-02-13T02:41:57.624545+0000","last_became_active":"2026-02-13T02:41:49.596572+0000","last_became_peered":"2026-02-13T02:41:49.596572+0000","last_unstale":"2026-02-13T02:41:57.624545+0000","last_undegraded":"2026-02-13T02:41:57.624545+0000","last_fullsized":"2026-02-13T02:41:57.624545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:02.816921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753645+0000","last_change":"2026-02-13T02:41:50.600695+0000","last_active":"2026-02-13T02:41:51.753645+0000","last_peered":"2026-02-13T02:41:51.753645+0000","last_clean":"2026-02-13T02:41:51.753645+0000","last_became_active":"2026-02-13T02:41:50.600453+0000","last_became_peered":"2026-02-13T02:41:50.600453+0000","last_unstale":"2026-02-13T02:41:51.753645+0000","last_undegraded":"2026-02-13T02:41:51.753645+0000","last_fullsized":"2026-02-13T02:41:51.753645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:50:55.092606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643996+0000","last_change":"2026-02-13T02:41:49.607644+0000","last_active":"2026-02-13T02:41:57.643996+0000","last_peered":"2026-02-13T02:41:57.643996+0000","last_clean":"2026-02-13T02:41:57.643996+0000","last_became_active":"2026-02-13T02:41:49.607523+0000","last_became_peered":"2026-02-13T02:41:49.607523+0000","last_unstale":"2026-02-13T02:41:57.643996+0000","last_undegraded":"2026-02-13T02:41:57.643996+0000","last_fullsized":"2026-02-13T02:41:57.643996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:38.869550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686358+0000","last_change":"2026-02-13T02:41:50.603530+0000","last_active":"2026-02-13T02:41:51.686358+0000","last_peered":"2026-02-13T02:41:51.686358+0000","last_clean":"2026-02-13T02:41:51.686358+0000","last_became_active":"2026-02-13T02:41:50.603312+0000","last_became_peered":"2026-02-13T02:41:50.603312+0000","last_unstale":"2026-02-13T02:41:51.686358+0000","last_undegraded":"2026-02-13T02:41:51.686358+0000","last_fullsized":"2026-02-13T02:41:51.686358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:20.510472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.788830+0000","last_change":"2026-02-13T02:41:49.602974+0000","last_active":"2026-02-13T02:41:51.788830+0000","last_peered":"2026-02-13T02:41:51.788830+0000","last_clean":"2026-02-13T02:41:51.788830+0000","last_became_active":"2026-02-13T02:41:49.602734+0000","last_became_peered":"2026-02-13T02:41:49.602734+0000","last_unstale":"2026-02-13T02:41:51.788830+0000","last_undegraded":"2026-02-13T02:41:51.788830+0000","last_fullsized":"2026-02-13T02:41:51.788830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:55.811253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686213+0000","last_change":"2026-02-13T02:41:50.609569+0000","last_active":"2026-02-13T02:41:51.686213+0000","last_peered":"2026-02-13T02:41:51.686213+0000","last_clean":"2026-02-13T02:41:51.686213+0000","last_became_active":"2026-02-13T02:41:50.609385+0000","last_became_peered":"2026-02-13T02:41:50.609385+0000","last_unstale":"2026-02-13T02:41:51.686213+0000","last_undegraded":"2026-02-13T02:41:51.686213+0000","last_fullsized":"2026-02-13T02:41:51.686213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:01:38.361410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.632961+0000","last_change":"2026-02-13T02:41:49.597872+0000","last_active":"2026-02-13T02:41:56.632961+0000","last_peered":"2026-02-13T02:41:56.632961+0000","last_clean":"2026-02-13T02:41:56.632961+0000","last_became_active":"2026-02-13T02:41:49.597687+0000","last_became_peered":"2026-02-13T02:41:49.597687+0000","last_unstale":"2026-02-13T02:41:56.632961+0000","last_undegraded":"2026-02-13T02:41:56.632961+0000","last_fullsized":"2026-02-13T02:41:56.632961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:34:50.926874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686331+0000","last_change":"2026-02-13T02:41:50.603749+0000","last_active":"2026-02-13T02:41:51.686331+0000","last_peered":"2026-02-13T02:41:51.686331+0000","last_clean":"2026-02-13T02:41:51.686331+0000","last_became_active":"2026-02-13T02:41:50.603582+0000","last_became_peered":"2026-02-13T02:41:50.603582+0000","last_unstale":"2026-02-13T02:41:51.686331+0000","last_undegraded":"2026-02-13T02:41:51.686331+0000","last_fullsized":"2026-02-13T02:41:51.686331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:21:18.911738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686050+0000","last_change":"2026-02-13T02:41:25.005343+0000","last_active":"2026-02-13T02:41:51.686050+0000","last_peered":"2026-02-13T02:41:51.686050+0000","last_clean":"2026-02-13T02:41:51.686050+0000","last_became_active":"2026-02-13T02:41:25.005110+0000","last_became_peered":"2026-02-13T02:41:25.005110+0000","last_unstale":"2026-02-13T02:41:51.686050+0000","last_undegraded":"2026-02-13T02:41:51.686050+0000","last_fullsized":"2026-02-13T02:41:51.686050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_clean_scrub_stamp":"2026-02-13T02:40:11.017896+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:17.735016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.644630+0000","last_change":"2026-02-13T02:41:49.601087+0000","last_active":"2026-02-13T02:41:58.644630+0000","last_peered":"2026-02-13T02:41:58.644630+0000","last_clean":"2026-02-13T02:41:58.644630+0000","last_became_active":"2026-02-13T02:41:49.600937+0000","last_became_peered":"2026-02-13T02:41:49.600937+0000","last_unstale":"2026-02-13T02:41:58.644630+0000","last_undegraded":"2026-02-13T02:41:58.644630+0000","last_fullsized":"2026-02-13T02:41:58.644630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:00.587519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597194+0000","last_change":"2026-02-13T02:41:50.606319+0000","last_active":"2026-02-13T02:41:51.597194+0000","last_peered":"2026-02-13T02:41:51.597194+0000","last_clean":"2026-02-13T02:41:51.597194+0000","last_became_active":"2026-02-13T02:41:50.605323+0000","last_became_peered":"2026-02-13T02:41:50.605323+0000","last_unstale":"2026-02-13T02:41:51.597194+0000","last_undegraded":"2026-02-13T02:41:51.597194+0000","last_fullsized":"2026-02-13T02:41:51.597194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:30:37.743457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.629312+0000","last_change":"2026-02-13T02:41:49.599872+0000","last_active":"2026-02-13T02:41:55.629312+0000","last_peered":"2026-02-13T02:41:55.629312+0000","last_clean":"2026-02-13T02:41:55.629312+0000","last_became_active":"2026-02-13T02:41:49.599659+0000","last_became_peered":"2026-02-13T02:41:49.599659+0000","last_unstale":"2026-02-13T02:41:55.629312+0000","last_undegraded":"2026-02-13T02:41:55.629312+0000","last_fullsized":"2026-02-13T02:41:55.629312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:50:27.800392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755902+0000","last_change":"2026-02-13T02:41:50.604627+0000","last_active":"2026-02-13T02:41:51.755902+0000","last_peered":"2026-02-13T02:41:51.755902+0000","last_clean":"2026-02-13T02:41:51.755902+0000","last_became_active":"2026-02-13T02:41:50.604541+0000","last_became_peered":"2026-02-13T02:41:50.604541+0000","last_unstale":"2026-02-13T02:41:51.755902+0000","last_undegraded":"2026-02-13T02:41:51.755902+0000","last_fullsized":"2026-02-13T02:41:51.755902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:43.968495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.629944+0000","last_change":"2026-02-13T02:41:49.608418+0000","last_active":"2026-02-13T02:41:55.629944+0000","last_peered":"2026-02-13T02:41:55.629944+0000","last_clean":"2026-02-13T02:41:55.629944+0000","last_became_active":"2026-02-13T02:41:49.608146+0000","last_became_peered":"2026-02-13T02:41:49.608146+0000","last_unstale":"2026-02-13T02:41:55.629944+0000","last_undegraded":"2026-02-13T02:41:55.629944+0000","last_fullsized":"2026-02-13T02:41:55.629944+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:51.291825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594339+0000","last_change":"2026-02-13T02:41:50.601808+0000","last_active":"2026-02-13T02:41:51.594339+0000","last_peered":"2026-02-13T02:41:51.594339+0000","last_clean":"2026-02-13T02:41:51.594339+0000","last_became_active":"2026-02-13T02:41:50.601452+0000","last_became_peered":"2026-02-13T02:41:50.601452+0000","last_unstale":"2026-02-13T02:41:51.594339+0000","last_undegraded":"2026-02-13T02:41:51.594339+0000","last_fullsized":"2026-02-13T02:41:51.594339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:33.347585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.647998+0000","last_change":"2026-02-13T02:41:49.602005+0000","last_active":"2026-02-13T02:41:58.647998+0000","last_peered":"2026-02-13T02:41:58.647998+0000","last_clean":"2026-02-13T02:41:58.647998+0000","last_became_active":"2026-02-13T02:41:49.601849+0000","last_became_peered":"2026-02-13T02:41:49.601849+0000","last_unstale":"2026-02-13T02:41:58.647998+0000","last_undegraded":"2026-02-13T02:41:58.647998+0000","last_fullsized":"2026-02-13T02:41:58.647998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:41.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598520+0000","last_change":"2026-02-13T02:41:50.605183+0000","last_active":"2026-02-13T02:41:51.598520+0000","last_peered":"2026-02-13T02:41:51.598520+0000","last_clean":"2026-02-13T02:41:51.598520+0000","last_became_active":"2026-02-13T02:41:50.604957+0000","last_became_peered":"2026-02-13T02:41:50.604957+0000","last_unstale":"2026-02-13T02:41:51.598520+0000","last_undegraded":"2026-02-13T02:41:51.598520+0000","last_fullsized":"2026-02-13T02:41:51.598520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:11.673149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756117+0000","last_change":"2026-02-13T02:41:49.600325+0000","last_active":"2026-02-13T02:41:51.756117+0000","last_peered":"2026-02-13T02:41:51.756117+0000","last_clean":"2026-02-13T02:41:51.756117+0000","last_became_active":"2026-02-13T02:41:49.600224+0000","last_became_peered":"2026-02-13T02:41:49.600224+0000","last_unstale":"2026-02-13T02:41:51.756117+0000","last_undegraded":"2026-02-13T02:41:51.756117+0000","last_fullsized":"2026-02-13T02:41:51.756117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:54.322610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598571+0000","last_change":"2026-02-13T02:41:50.606498+0000","last_active":"2026-02-13T02:41:51.598571+0000","last_peered":"2026-02-13T02:41:51.598571+0000","last_clean":"2026-02-13T02:41:51.598571+0000","last_became_active":"2026-02-13T02:41:50.606363+0000","last_became_peered":"2026-02-13T02:41:50.606363+0000","last_unstale":"2026-02-13T02:41:51.598571+0000","last_undegraded":"2026-02-13T02:41:51.598571+0000","last_fullsized":"2026-02-13T02:41:51.598571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:01:26.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.642011+0000","last_change":"2026-02-13T02:41:49.598219+0000","last_active":"2026-02-13T02:41:57.642011+0000","last_peered":"2026-02-13T02:41:57.642011+0000","last_clean":"2026-02-13T02:41:57.642011+0000","last_became_active":"2026-02-13T02:41:49.598085+0000","last_became_peered":"2026-02-13T02:41:49.598085+0000","last_unstale":"2026-02-13T02:41:57.642011+0000","last_undegraded":"2026-02-13T02:41:57.642011+0000","last_fullsized":"2026-02-13T02:41:57.642011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:57.092957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756305+0000","last_change":"2026-02-13T02:41:50.608035+0000","last_active":"2026-02-13T02:41:51.756305+0000","last_peered":"2026-02-13T02:41:51.756305+0000","last_clean":"2026-02-13T02:41:51.756305+0000","last_became_active":"2026-02-13T02:41:50.607792+0000","last_became_peered":"2026-02-13T02:41:50.607792+0000","last_unstale":"2026-02-13T02:41:51.756305+0000","last_undegraded":"2026-02-13T02:41:51.756305+0000","last_fullsized":"2026-02-13T02:41:51.756305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:54.002715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.036888+0000","last_change":"2026-02-13T02:41:49.607784+0000","last_active":"2026-02-13T02:41:58.036888+0000","last_peered":"2026-02-13T02:41:58.036888+0000","last_clean":"2026-02-13T02:41:58.036888+0000","last_became_active":"2026-02-13T02:41:49.607602+0000","last_became_peered":"2026-02-13T02:41:49.607602+0000","last_unstale":"2026-02-13T02:41:58.036888+0000","last_undegraded":"2026-02-13T02:41:58.036888+0000","last_fullsized":"2026-02-13T02:41:58.036888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:36.215383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597453+0000","last_change":"2026-02-13T02:41:50.607352+0000","last_active":"2026-02-13T02:41:51.597453+0000","last_peered":"2026-02-13T02:41:51.597453+0000","last_clean":"2026-02-13T02:41:51.597453+0000","last_became_active":"2026-02-13T02:41:50.607212+0000","last_became_peered":"2026-02-13T02:41:50.607212+0000","last_unstale":"2026-02-13T02:41:51.597453+0000","last_undegraded":"2026-02-13T02:41:51.597453+0000","last_fullsized":"2026-02-13T02:41:51.597453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:52.063018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643960+0000","last_change":"2026-02-13T02:41:49.600639+0000","last_active":"2026-02-13T02:41:57.643960+0000","last_peered":"2026-02-13T02:41:57.643960+0000","last_clean":"2026-02-13T02:41:57.643960+0000","last_became_active":"2026-02-13T02:41:49.600493+0000","last_became_peered":"2026-02-13T02:41:49.600493+0000","last_unstale":"2026-02-13T02:41:57.643960+0000","last_undegraded":"2026-02-13T02:41:57.643960+0000","last_fullsized":"2026-02-13T02:41:57.643960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:49:51.847533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756691+0000","last_change":"2026-02-13T02:41:50.608701+0000","last_active":"2026-02-13T02:41:51.756691+0000","last_peered":"2026-02-13T02:41:51.756691+0000","last_clean":"2026-02-13T02:41:51.756691+0000","last_became_active":"2026-02-13T02:41:50.608587+0000","last_became_peered":"2026-02-13T02:41:50.608587+0000","last_unstale":"2026-02-13T02:41:51.756691+0000","last_undegraded":"2026-02-13T02:41:51.756691+0000","last_fullsized":"2026-02-13T02:41:51.756691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:51.204751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.623861+0000","last_change":"2026-02-13T02:41:49.603944+0000","last_active":"2026-02-13T02:41:54.623861+0000","last_peered":"2026-02-13T02:41:54.623861+0000","last_clean":"2026-02-13T02:41:54.623861+0000","last_became_active":"2026-02-13T02:41:49.603771+0000","last_became_peered":"2026-02-13T02:41:49.603771+0000","last_unstale":"2026-02-13T02:41:54.623861+0000","last_undegraded":"2026-02-13T02:41:54.623861+0000","last_fullsized":"2026-02-13T02:41:54.623861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:02.938077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638571+0000","last_change":"2026-02-13T02:41:50.600369+0000","last_active":"2026-02-13T02:41:51.638571+0000","last_peered":"2026-02-13T02:41:51.638571+0000","last_clean":"2026-02-13T02:41:51.638571+0000","last_became_active":"2026-02-13T02:41:50.600236+0000","last_became_peered":"2026-02-13T02:41:50.600236+0000","last_unstale":"2026-02-13T02:41:51.638571+0000","last_undegraded":"2026-02-13T02:41:51.638571+0000","last_fullsized":"2026-02-13T02:41:51.638571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:33.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.636786+0000","last_change":"2026-02-13T02:41:49.606756+0000","last_active":"2026-02-13T02:41:56.636786+0000","last_peered":"2026-02-13T02:41:56.636786+0000","last_clean":"2026-02-13T02:41:56.636786+0000","last_became_active":"2026-02-13T02:41:49.606577+0000","last_became_peered":"2026-02-13T02:41:49.606577+0000","last_unstale":"2026-02-13T02:41:56.636786+0000","last_undegraded":"2026-02-13T02:41:56.636786+0000","last_fullsized":"2026-02-13T02:41:56.636786+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:22.336094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753650+0000","last_change":"2026-02-13T02:41:50.596967+0000","last_active":"2026-02-13T02:41:51.753650+0000","last_peered":"2026-02-13T02:41:51.753650+0000","last_clean":"2026-02-13T02:41:51.753650+0000","last_became_active":"2026-02-13T02:41:50.596798+0000","last_became_peered":"2026-02-13T02:41:50.596798+0000","last_unstale":"2026-02-13T02:41:51.753650+0000","last_undegraded":"2026-02-13T02:41:51.753650+0000","last_fullsized":"2026-02-13T02:41:51.753650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:46.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.618957+0000","last_change":"2026-02-13T02:41:49.605314+0000","last_active":"2026-02-13T02:41:56.618957+0000","last_peered":"2026-02-13T02:41:56.618957+0000","last_clean":"2026-02-13T02:41:56.618957+0000","last_became_active":"2026-02-13T02:41:49.605183+0000","last_became_peered":"2026-02-13T02:41:49.605183+0000","last_unstale":"2026-02-13T02:41:56.618957+0000","last_undegraded":"2026-02-13T02:41:56.618957+0000","last_fullsized":"2026-02-13T02:41:56.618957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:55.197111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597243+0000","last_change":"2026-02-13T02:41:50.605693+0000","last_active":"2026-02-13T02:41:51.597243+0000","last_peered":"2026-02-13T02:41:51.597243+0000","last_clean":"2026-02-13T02:41:51.597243+0000","last_became_active":"2026-02-13T02:41:50.605095+0000","last_became_peered":"2026-02-13T02:41:50.605095+0000","last_unstale":"2026-02-13T02:41:51.597243+0000","last_undegraded":"2026-02-13T02:41:51.597243+0000","last_fullsized":"2026-02-13T02:41:51.597243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:20.729194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.620279+0000","last_change":"2026-02-13T02:41:49.597243+0000","last_active":"2026-02-13T02:41:54.620279+0000","last_peered":"2026-02-13T02:41:54.620279+0000","last_clean":"2026-02-13T02:41:54.620279+0000","last_became_active":"2026-02-13T02:41:49.596866+0000","last_became_peered":"2026-02-13T02:41:49.596866+0000","last_unstale":"2026-02-13T02:41:54.620279+0000","last_undegraded":"2026-02-13T02:41:54.620279+0000","last_fullsized":"2026-02-13T02:41:54.620279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:29:38.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686068+0000","last_change":"2026-02-13T02:41:50.606794+0000","last_active":"2026-02-13T02:41:51.686068+0000","last_peered":"2026-02-13T02:41:51.686068+0000","last_clean":"2026-02-13T02:41:51.686068+0000","last_became_active":"2026-02-13T02:41:50.606595+0000","last_became_peered":"2026-02-13T02:41:50.606595+0000","last_unstale":"2026-02-13T02:41:51.686068+0000","last_undegraded":"2026-02-13T02:41:51.686068+0000","last_fullsized":"2026-02-13T02:41:51.686068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:24.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594579+0000","last_change":"2026-02-13T02:41:50.602019+0000","last_active":"2026-02-13T02:41:51.594579+0000","last_peered":"2026-02-13T02:41:51.594579+0000","last_clean":"2026-02-13T02:41:51.594579+0000","last_became_active":"2026-02-13T02:41:50.601731+0000","last_became_peered":"2026-02-13T02:41:50.601731+0000","last_unstale":"2026-02-13T02:41:51.594579+0000","last_undegraded":"2026-02-13T02:41:51.594579+0000","last_fullsized":"2026-02-13T02:41:51.594579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:19.211804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639877+0000","last_change":"2026-02-13T02:41:49.596759+0000","last_active":"2026-02-13T02:41:57.639877+0000","last_peered":"2026-02-13T02:41:57.639877+0000","last_clean":"2026-02-13T02:41:57.639877+0000","last_became_active":"2026-02-13T02:41:49.596314+0000","last_became_peered":"2026-02-13T02:41:49.596314+0000","last_unstale":"2026-02-13T02:41:57.639877+0000","last_undegraded":"2026-02-13T02:41:57.639877+0000","last_fullsized":"2026-02-13T02:41:57.639877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:20:20.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756768+0000","last_change":"2026-02-13T02:41:50.605832+0000","last_active":"2026-02-13T02:41:51.756768+0000","last_peered":"2026-02-13T02:41:51.756768+0000","last_clean":"2026-02-13T02:41:51.756768+0000","last_became_active":"2026-02-13T02:41:50.605574+0000","last_became_peered":"2026-02-13T02:41:50.605574+0000","last_unstale":"2026-02-13T02:41:51.756768+0000","last_undegraded":"2026-02-13T02:41:51.756768+0000","last_fullsized":"2026-02-13T02:41:51.756768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:33:32.847010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.638633+0000","last_change":"2026-02-13T02:41:49.596987+0000","last_active":"2026-02-13T02:41:58.638633+0000","last_peered":"2026-02-13T02:41:58.638633+0000","last_clean":"2026-02-13T02:41:58.638633+0000","last_became_active":"2026-02-13T02:41:49.596599+0000","last_became_peered":"2026-02-13T02:41:49.596599+0000","last_unstale":"2026-02-13T02:41:58.638633+0000","last_undegraded":"2026-02-13T02:41:58.638633+0000","last_fullsized":"2026-02-13T02:41:58.638633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:30.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756702+0000","last_change":"2026-02-13T02:41:50.610429+0000","last_active":"2026-02-13T02:41:51.756702+0000","last_peered":"2026-02-13T02:41:51.756702+0000","last_clean":"2026-02-13T02:41:51.756702+0000","last_became_active":"2026-02-13T02:41:50.610239+0000","last_became_peered":"2026-02-13T02:41:50.610239+0000","last_unstale":"2026-02-13T02:41:51.756702+0000","last_undegraded":"2026-02-13T02:41:51.756702+0000","last_fullsized":"2026-02-13T02:41:51.756702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:40.272140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:52.062405+0000","last_change":"2026-02-13T02:41:49.606193+0000","last_active":"2026-02-13T02:41:52.062405+0000","last_peered":"2026-02-13T02:41:52.062405+0000","last_clean":"2026-02-13T02:41:52.062405+0000","last_became_active":"2026-02-13T02:41:49.606085+0000","last_became_peered":"2026-02-13T02:41:49.606085+0000","last_unstale":"2026-02-13T02:41:52.062405+0000","last_undegraded":"2026-02-13T02:41:52.062405+0000","last_fullsized":"2026-02-13T02:41:52.062405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:49:14.551780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597364+0000","last_change":"2026-02-13T02:41:50.608679+0000","last_active":"2026-02-13T02:41:51.597364+0000","last_peered":"2026-02-13T02:41:51.597364+0000","last_clean":"2026-02-13T02:41:51.597364+0000","last_became_active":"2026-02-13T02:41:50.607474+0000","last_became_peered":"2026-02-13T02:41:50.607474+0000","last_unstale":"2026-02-13T02:41:51.597364+0000","last_undegraded":"2026-02-13T02:41:51.597364+0000","last_fullsized":"2026-02-13T02:41:51.597364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:49:25.463410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.645168+0000","last_change":"2026-02-13T02:41:49.599289+0000","last_active":"2026-02-13T02:41:58.645168+0000","last_peered":"2026-02-13T02:41:58.645168+0000","last_clean":"2026-02-13T02:41:58.645168+0000","last_became_active":"2026-02-13T02:41:49.598567+0000","last_became_peered":"2026-02-13T02:41:49.598567+0000","last_unstale":"2026-02-13T02:41:58.645168+0000","last_undegraded":"2026-02-13T02:41:58.645168+0000","last_fullsized":"2026-02-13T02:41:58.645168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:23.527572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8576,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":199,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":49848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":293644,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264489,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710728,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":399099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939656,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":991077,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":25731,"internal_metadata":27564925},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103179,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":398619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32442,"internal_metadata":27558214},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332109,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":399019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32992,"internal_metadata":27557664},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561038,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":991966,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34554,"internal_metadata":27556102},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":398197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34870,"internal_metadata":27555786},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920785,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":989341,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":27642,"internal_metadata":27563014},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051603,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":398585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43851,"internal_metadata":27546805},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280533,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":397759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43918,"internal_metadata":27546738},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":56,"kb_used_meta":26887,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":400481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57502,"internal_metadata":27533154},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640280,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":424865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45723,"internal_metadata":27544933},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":400107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50354,"internal_metadata":27540302},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11364,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":27390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2724,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56417,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43431,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26177,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9340,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11905,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32965,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31071,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31332,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30954,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5964,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:42:02.089 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:42:02.272 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:02.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.477+0000 7fab2b5776c0 1 -- 10.20.193.78:0/541253604 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fab2c115270 msgr2=0x7fab2c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:02.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.477+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/541253604 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fab2c115270 0x7fab2c175c10 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=2511827291613523312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab1c00aa70 tx=0x7fab1c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.478+0000 7fab2b5776c0 1 -- 10.20.193.78:0/541253604 shutdown_connections 2026-02-13T02:42:02.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.478+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/541253604 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fab2c115270 0x7fab2c175c10 unknown :-1 s=CLOSED pgs=174 gs=1 cs=0 l=1 c_cookie=2511827291613523312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.478+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/541253604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10fa50 0x7fab2c114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.478+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/541253604 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab2c10f060 0x7fab2c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.478+0000 7fab2b5776c0 1 -- 10.20.193.78:0/541253604 >> 10.20.193.78:0/541253604 conn(0x7fab2c0ec980 msgr2=0x7fab2c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:02.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.478+0000 7fab2b5776c0 1 -- 10.20.193.78:0/541253604 shutdown_connections 2026-02-13T02:42:02.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.478+0000 7fab2b5776c0 1 -- 10.20.193.78:0/541253604 wait complete. 2026-02-13T02:42:02.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.479+0000 7fab2b5776c0 1 Processor -- start 2026-02-13T02:42:02.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.479+0000 7fab2b5776c0 1 -- start start 2026-02-13T02:42:02.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2b5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10f060 0x7fab2c11cf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2b5776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fab2c115270 0x7fab2c11d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2b5776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab2c122890 0x7fab2c122d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2b5776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c1232a0 con 0x7fab2c115270 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2b5776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c123410 con 0x7fab2c10f060 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2b5776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c1235d0 con 0x7fab2c122890 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10f060 0x7fab2c11cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10f060 0x7fab2c11cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:52892/0 (socket says 10.20.193.78:52892) 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 -- 10.20.193.78:0/2231654339 learned_addr learned my addr 10.20.193.78:0/2231654339 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2ad766c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab2c122890 0x7fab2c122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 -- 10.20.193.78:0/2231654339 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab2c122890 msgr2=0x7fab2c122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:02.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab2c122890 0x7fab2c122d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 -- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fab2c115270 msgr2=0x7fab2c11d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fab2c115270 0x7fab2c11d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 -- 10.20.193.78:0/2231654339 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c00a660 con 0x7fab2c10f060 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2a5756c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10f060 0x7fab2c11cf90 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab20009490 tx=0x7fab2000bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab137fe6c0 1 -- 10.20.193.78:0/2231654339 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab20004a80 con 0x7fab2c10f060 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab137fe6c0 1 -- 10.20.193.78:0/2231654339 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fab20009030 con 0x7fab2c10f060 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.480+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2c163a80 con 0x7fab2c10f060 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.481+0000 7fab137fe6c0 1 -- 10.20.193.78:0/2231654339 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab2000ce50 con 0x7fab2c10f060 2026-02-13T02:42:02.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.481+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2c163f10 con 0x7fab2c10f060 2026-02-13T02:42:02.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.481+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab2c110330 con 0x7fab2c10f060 2026-02-13T02:42:02.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.483+0000 7fab137fe6c0 1 -- 10.20.193.78:0/2231654339 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fab20004080 con 0x7fab2c10f060 2026-02-13T02:42:02.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.485+0000 7fab137fe6c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fab040b56e0 0x7fab040d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:02.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.485+0000 7fab137fe6c0 1 -- 10.20.193.78:0/2231654339 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fab200e3d10 con 0x7fab2c10f060 2026-02-13T02:42:02.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.485+0000 7fab137fe6c0 1 -- 10.20.193.78:0/2231654339 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fab200e4190 con 0x7fab2c10f060 2026-02-13T02:42:02.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.485+0000 7fab29d746c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fab040b56e0 0x7fab040d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:02.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.485+0000 7fab29d746c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fab040b56e0 0x7fab040d5b90 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab2c123920 tx=0x7fab140096a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:02.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.585+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab2c10fa50 con 0x7fab040b56e0 2026-02-13T02:42:02.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.588+0000 7fab137fe6c0 1 -- 10.20.193.78:0/2231654339 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258950 (secure 0 0 0) 0x7fab2c10fa50 con 0x7fab040b56e0 2026-02-13T02:42:02.594 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:02.595 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T02:42:02.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.590+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fab040b56e0 msgr2=0x7fab040d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:02.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.590+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fab040b56e0 0x7fab040d5b90 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab2c123920 tx=0x7fab140096a0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.590+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10f060 msgr2=0x7fab2c11cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:02.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.590+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10f060 0x7fab2c11cf90 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab20009490 tx=0x7fab2000bc50 comp rx=0 tx=0).stop 2026-02-13T02:42:02.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 shutdown_connections 2026-02-13T02:42:02.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fab040b56e0 0x7fab040d5b90 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab2c122890 0x7fab2c122d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fab2c115270 0x7fab2c11d4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 --2- 10.20.193.78:0/2231654339 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab2c10f060 0x7fab2c11cf90 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:02.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 >> 10.20.193.78:0/2231654339 conn(0x7fab2c0ec980 msgr2=0x7fab2c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:02.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 shutdown_connections 2026-02-13T02:42:02.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:02.591+0000 7fab2b5776c0 1 -- 10.20.193.78:0/2231654339 wait complete. 2026-02-13T02:42:02.692 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2026-02-13T02:42:01.622074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599061,"num_objects":96,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":389,"num_write_kb":3782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":325,"ondisk_log_size":325,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333628,"kb_used_data":10060,"kb_used_omap":428,"kb_used_meta":322899,"kb_avail":8807704772,"statfs":{"total":9019431321600,"available":9019089686528,"internally_reserved":0,"allocated":10301440,"data_stored":6589115,"data_compressed":114759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":439045,"internal_metadata":330648827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8693,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":200,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.026371"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753798+0000","last_change":"2026-02-13T02:41:50.599914+0000","last_active":"2026-02-13T02:41:51.753798+0000","last_peered":"2026-02-13T02:41:51.753798+0000","last_clean":"2026-02-13T02:41:51.753798+0000","last_became_active":"2026-02-13T02:41:50.599730+0000","last_became_peered":"2026-02-13T02:41:50.599730+0000","last_unstale":"2026-02-13T02:41:51.753798+0000","last_undegraded":"2026-02-13T02:41:51.753798+0000","last_fullsized":"2026-02-13T02:41:51.753798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:03:13.109709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756660+0000","last_change":"2026-02-13T02:41:50.600052+0000","last_active":"2026-02-13T02:41:51.756660+0000","last_peered":"2026-02-13T02:41:51.756660+0000","last_clean":"2026-02-13T02:41:51.756660+0000","last_became_active":"2026-02-13T02:41:50.599602+0000","last_became_peered":"2026-02-13T02:41:50.599602+0000","last_unstale":"2026-02-13T02:41:51.756660+0000","last_undegraded":"2026-02-13T02:41:51.756660+0000","last_fullsized":"2026-02-13T02:41:51.756660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:52.030776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756493+0000","last_change":"2026-02-13T02:41:50.603536+0000","last_active":"2026-02-13T02:41:51.756493+0000","last_peered":"2026-02-13T02:41:51.756493+0000","last_clean":"2026-02-13T02:41:51.756493+0000","last_became_active":"2026-02-13T02:41:50.603397+0000","last_became_peered":"2026-02-13T02:41:50.603397+0000","last_unstale":"2026-02-13T02:41:51.756493+0000","last_undegraded":"2026-02-13T02:41:51.756493+0000","last_fullsized":"2026-02-13T02:41:51.756493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:53.008982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.757018+0000","last_change":"2026-02-13T02:41:50.605058+0000","last_active":"2026-02-13T02:41:51.757018+0000","last_peered":"2026-02-13T02:41:51.757018+0000","last_clean":"2026-02-13T02:41:51.757018+0000","last_became_active":"2026-02-13T02:41:50.604762+0000","last_became_peered":"2026-02-13T02:41:50.604762+0000","last_unstale":"2026-02-13T02:41:51.757018+0000","last_undegraded":"2026-02-13T02:41:51.757018+0000","last_fullsized":"2026-02-13T02:41:51.757018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:25.425794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638592+0000","last_change":"2026-02-13T02:41:50.603698+0000","last_active":"2026-02-13T02:41:51.638592+0000","last_peered":"2026-02-13T02:41:51.638592+0000","last_clean":"2026-02-13T02:41:51.638592+0000","last_became_active":"2026-02-13T02:41:50.603555+0000","last_became_peered":"2026-02-13T02:41:50.603555+0000","last_unstale":"2026-02-13T02:41:51.638592+0000","last_undegraded":"2026-02-13T02:41:51.638592+0000","last_fullsized":"2026-02-13T02:41:51.638592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:05.519511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598097+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.598097+0000","last_peered":"2026-02-13T02:41:51.598097+0000","last_clean":"2026-02-13T02:41:51.598097+0000","last_became_active":"2026-02-13T02:41:50.607050+0000","last_became_peered":"2026-02-13T02:41:50.607050+0000","last_unstale":"2026-02-13T02:41:51.598097+0000","last_undegraded":"2026-02-13T02:41:51.598097+0000","last_fullsized":"2026-02-13T02:41:51.598097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:36.348221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685915+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.685915+0000","last_peered":"2026-02-13T02:41:51.685915+0000","last_clean":"2026-02-13T02:41:51.685915+0000","last_became_active":"2026-02-13T02:41:50.607052+0000","last_became_peered":"2026-02-13T02:41:50.607052+0000","last_unstale":"2026-02-13T02:41:51.685915+0000","last_undegraded":"2026-02-13T02:41:51.685915+0000","last_fullsized":"2026-02-13T02:41:51.685915+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:09.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596911+0000","last_change":"2026-02-13T02:41:50.606858+0000","last_active":"2026-02-13T02:41:51.596911+0000","last_peered":"2026-02-13T02:41:51.596911+0000","last_clean":"2026-02-13T02:41:51.596911+0000","last_became_active":"2026-02-13T02:41:50.606045+0000","last_became_peered":"2026-02-13T02:41:50.606045+0000","last_unstale":"2026-02-13T02:41:51.596911+0000","last_undegraded":"2026-02-13T02:41:51.596911+0000","last_fullsized":"2026-02-13T02:41:51.596911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:05.276035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756934+0000","last_change":"2026-02-13T02:41:50.604103+0000","last_active":"2026-02-13T02:41:51.756934+0000","last_peered":"2026-02-13T02:41:51.756934+0000","last_clean":"2026-02-13T02:41:51.756934+0000","last_became_active":"2026-02-13T02:41:50.603863+0000","last_became_peered":"2026-02-13T02:41:50.603863+0000","last_unstale":"2026-02-13T02:41:51.756934+0000","last_undegraded":"2026-02-13T02:41:51.756934+0000","last_fullsized":"2026-02-13T02:41:51.756934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:35:13.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598569+0000","last_change":"2026-02-13T02:41:50.604086+0000","last_active":"2026-02-13T02:41:51.598569+0000","last_peered":"2026-02-13T02:41:51.598569+0000","last_clean":"2026-02-13T02:41:51.598569+0000","last_became_active":"2026-02-13T02:41:50.603680+0000","last_became_peered":"2026-02-13T02:41:50.603680+0000","last_unstale":"2026-02-13T02:41:51.598569+0000","last_undegraded":"2026-02-13T02:41:51.598569+0000","last_fullsized":"2026-02-13T02:41:51.598569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:24:37.164379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686176+0000","last_change":"2026-02-13T02:41:50.605319+0000","last_active":"2026-02-13T02:41:51.686176+0000","last_peered":"2026-02-13T02:41:51.686176+0000","last_clean":"2026-02-13T02:41:51.686176+0000","last_became_active":"2026-02-13T02:41:50.605054+0000","last_became_peered":"2026-02-13T02:41:50.605054+0000","last_unstale":"2026-02-13T02:41:51.686176+0000","last_undegraded":"2026-02-13T02:41:51.686176+0000","last_fullsized":"2026-02-13T02:41:51.686176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:25:10.690555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756968+0000","last_change":"2026-02-13T02:41:50.604779+0000","last_active":"2026-02-13T02:41:51.756968+0000","last_peered":"2026-02-13T02:41:51.756968+0000","last_clean":"2026-02-13T02:41:51.756968+0000","last_became_active":"2026-02-13T02:41:50.604459+0000","last_became_peered":"2026-02-13T02:41:50.604459+0000","last_unstale":"2026-02-13T02:41:51.756968+0000","last_undegraded":"2026-02-13T02:41:51.756968+0000","last_fullsized":"2026-02-13T02:41:51.756968+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:56:44.125622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756288+0000","last_change":"2026-02-13T02:41:50.605422+0000","last_active":"2026-02-13T02:41:51.756288+0000","last_peered":"2026-02-13T02:41:51.756288+0000","last_clean":"2026-02-13T02:41:51.756288+0000","last_became_active":"2026-02-13T02:41:50.605329+0000","last_became_peered":"2026-02-13T02:41:50.605329+0000","last_unstale":"2026-02-13T02:41:51.756288+0000","last_undegraded":"2026-02-13T02:41:51.756288+0000","last_fullsized":"2026-02-13T02:41:51.756288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:16.056010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755988+0000","last_change":"2026-02-13T02:41:50.602168+0000","last_active":"2026-02-13T02:41:51.755988+0000","last_peered":"2026-02-13T02:41:51.755988+0000","last_clean":"2026-02-13T02:41:51.755988+0000","last_became_active":"2026-02-13T02:41:50.601828+0000","last_became_peered":"2026-02-13T02:41:50.601828+0000","last_unstale":"2026-02-13T02:41:51.755988+0000","last_undegraded":"2026-02-13T02:41:51.755988+0000","last_fullsized":"2026-02-13T02:41:51.755988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:44.301005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756057+0000","last_change":"2026-02-13T02:41:50.603578+0000","last_active":"2026-02-13T02:41:51.756057+0000","last_peered":"2026-02-13T02:41:51.756057+0000","last_clean":"2026-02-13T02:41:51.756057+0000","last_became_active":"2026-02-13T02:41:50.603419+0000","last_became_peered":"2026-02-13T02:41:50.603419+0000","last_unstale":"2026-02-13T02:41:51.756057+0000","last_undegraded":"2026-02-13T02:41:51.756057+0000","last_fullsized":"2026-02-13T02:41:51.756057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:51:21.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756604+0000","last_change":"2026-02-13T02:41:50.604104+0000","last_active":"2026-02-13T02:41:51.756604+0000","last_peered":"2026-02-13T02:41:51.756604+0000","last_clean":"2026-02-13T02:41:51.756604+0000","last_became_active":"2026-02-13T02:41:50.603842+0000","last_became_peered":"2026-02-13T02:41:50.603842+0000","last_unstale":"2026-02-13T02:41:51.756604+0000","last_undegraded":"2026-02-13T02:41:51.756604+0000","last_fullsized":"2026-02-13T02:41:51.756604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:39:14.046728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753888+0000","last_change":"2026-02-13T02:41:50.600064+0000","last_active":"2026-02-13T02:41:51.753888+0000","last_peered":"2026-02-13T02:41:51.753888+0000","last_clean":"2026-02-13T02:41:51.753888+0000","last_became_active":"2026-02-13T02:41:50.599816+0000","last_became_peered":"2026-02-13T02:41:50.599816+0000","last_unstale":"2026-02-13T02:41:51.753888+0000","last_undegraded":"2026-02-13T02:41:51.753888+0000","last_fullsized":"2026-02-13T02:41:51.753888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:21.509074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756002+0000","last_change":"2026-02-13T02:41:50.603623+0000","last_active":"2026-02-13T02:41:51.756002+0000","last_peered":"2026-02-13T02:41:51.756002+0000","last_clean":"2026-02-13T02:41:51.756002+0000","last_became_active":"2026-02-13T02:41:50.603557+0000","last_became_peered":"2026-02-13T02:41:50.603557+0000","last_unstale":"2026-02-13T02:41:51.756002+0000","last_undegraded":"2026-02-13T02:41:51.756002+0000","last_fullsized":"2026-02-13T02:41:51.756002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:43.142827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594535+0000","last_change":"2026-02-13T02:41:50.604758+0000","last_active":"2026-02-13T02:41:51.594535+0000","last_peered":"2026-02-13T02:41:51.594535+0000","last_clean":"2026-02-13T02:41:51.594535+0000","last_became_active":"2026-02-13T02:41:50.604617+0000","last_became_peered":"2026-02-13T02:41:50.604617+0000","last_unstale":"2026-02-13T02:41:51.594535+0000","last_undegraded":"2026-02-13T02:41:51.594535+0000","last_fullsized":"2026-02-13T02:41:51.594535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:50.763524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753576+0000","last_change":"2026-02-13T02:41:50.601097+0000","last_active":"2026-02-13T02:41:51.753576+0000","last_peered":"2026-02-13T02:41:51.753576+0000","last_clean":"2026-02-13T02:41:51.753576+0000","last_became_active":"2026-02-13T02:41:50.600904+0000","last_became_peered":"2026-02-13T02:41:50.600904+0000","last_unstale":"2026-02-13T02:41:51.753576+0000","last_undegraded":"2026-02-13T02:41:51.753576+0000","last_fullsized":"2026-02-13T02:41:51.753576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:28:11.088460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756282+0000","last_change":"2026-02-13T02:41:50.610769+0000","last_active":"2026-02-13T02:41:51.756282+0000","last_peered":"2026-02-13T02:41:51.756282+0000","last_clean":"2026-02-13T02:41:51.756282+0000","last_became_active":"2026-02-13T02:41:50.610617+0000","last_became_peered":"2026-02-13T02:41:50.610617+0000","last_unstale":"2026-02-13T02:41:51.756282+0000","last_undegraded":"2026-02-13T02:41:51.756282+0000","last_fullsized":"2026-02-13T02:41:51.756282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:46.547410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756657+0000","last_change":"2026-02-13T02:41:50.607490+0000","last_active":"2026-02-13T02:41:51.756657+0000","last_peered":"2026-02-13T02:41:51.756657+0000","last_clean":"2026-02-13T02:41:51.756657+0000","last_became_active":"2026-02-13T02:41:50.607298+0000","last_became_peered":"2026-02-13T02:41:50.607298+0000","last_unstale":"2026-02-13T02:41:51.756657+0000","last_undegraded":"2026-02-13T02:41:51.756657+0000","last_fullsized":"2026-02-13T02:41:51.756657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:07.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596921+0000","last_change":"2026-02-13T02:41:50.606974+0000","last_active":"2026-02-13T02:41:51.596921+0000","last_peered":"2026-02-13T02:41:51.596921+0000","last_clean":"2026-02-13T02:41:51.596921+0000","last_became_active":"2026-02-13T02:41:50.606344+0000","last_became_peered":"2026-02-13T02:41:50.606344+0000","last_unstale":"2026-02-13T02:41:51.596921+0000","last_undegraded":"2026-02-13T02:41:51.596921+0000","last_fullsized":"2026-02-13T02:41:51.596921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:12.593325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594547+0000","last_change":"2026-02-13T02:41:50.605952+0000","last_active":"2026-02-13T02:41:51.594547+0000","last_peered":"2026-02-13T02:41:51.594547+0000","last_clean":"2026-02-13T02:41:51.594547+0000","last_became_active":"2026-02-13T02:41:50.605843+0000","last_became_peered":"2026-02-13T02:41:50.605843+0000","last_unstale":"2026-02-13T02:41:51.594547+0000","last_undegraded":"2026-02-13T02:41:51.594547+0000","last_fullsized":"2026-02-13T02:41:51.594547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:43:56.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597412+0000","last_change":"2026-02-13T02:41:50.607967+0000","last_active":"2026-02-13T02:41:51.597412+0000","last_peered":"2026-02-13T02:41:51.597412+0000","last_clean":"2026-02-13T02:41:51.597412+0000","last_became_active":"2026-02-13T02:41:50.607467+0000","last_became_peered":"2026-02-13T02:41:50.607467+0000","last_unstale":"2026-02-13T02:41:51.597412+0000","last_undegraded":"2026-02-13T02:41:51.597412+0000","last_fullsized":"2026-02-13T02:41:51.597412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:02.579210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594625+0000","last_change":"2026-02-13T02:41:50.599821+0000","last_active":"2026-02-13T02:41:51.594625+0000","last_peered":"2026-02-13T02:41:51.594625+0000","last_clean":"2026-02-13T02:41:51.594625+0000","last_became_active":"2026-02-13T02:41:50.599654+0000","last_became_peered":"2026-02-13T02:41:50.599654+0000","last_unstale":"2026-02-13T02:41:51.594625+0000","last_undegraded":"2026-02-13T02:41:51.594625+0000","last_fullsized":"2026-02-13T02:41:51.594625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:32:20.138295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753717+0000","last_change":"2026-02-13T02:41:50.600422+0000","last_active":"2026-02-13T02:41:51.753717+0000","last_peered":"2026-02-13T02:41:51.753717+0000","last_clean":"2026-02-13T02:41:51.753717+0000","last_became_active":"2026-02-13T02:41:50.600118+0000","last_became_peered":"2026-02-13T02:41:50.600118+0000","last_unstale":"2026-02-13T02:41:51.753717+0000","last_undegraded":"2026-02-13T02:41:51.753717+0000","last_fullsized":"2026-02-13T02:41:51.753717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:18:51.209188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756265+0000","last_change":"2026-02-13T02:41:50.611343+0000","last_active":"2026-02-13T02:41:51.756265+0000","last_peered":"2026-02-13T02:41:51.756265+0000","last_clean":"2026-02-13T02:41:51.756265+0000","last_became_active":"2026-02-13T02:41:50.611129+0000","last_became_peered":"2026-02-13T02:41:50.611129+0000","last_unstale":"2026-02-13T02:41:51.756265+0000","last_undegraded":"2026-02-13T02:41:51.756265+0000","last_fullsized":"2026-02-13T02:41:51.756265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:26.181721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756482+0000","last_change":"2026-02-13T02:41:50.610427+0000","last_active":"2026-02-13T02:41:51.756482+0000","last_peered":"2026-02-13T02:41:51.756482+0000","last_clean":"2026-02-13T02:41:51.756482+0000","last_became_active":"2026-02-13T02:41:50.609859+0000","last_became_peered":"2026-02-13T02:41:50.609859+0000","last_unstale":"2026-02-13T02:41:51.756482+0000","last_undegraded":"2026-02-13T02:41:51.756482+0000","last_fullsized":"2026-02-13T02:41:51.756482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:35:38.289372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594356+0000","last_change":"2026-02-13T02:41:50.606399+0000","last_active":"2026-02-13T02:41:51.594356+0000","last_peered":"2026-02-13T02:41:51.594356+0000","last_clean":"2026-02-13T02:41:51.594356+0000","last_became_active":"2026-02-13T02:41:50.606261+0000","last_became_peered":"2026-02-13T02:41:50.606261+0000","last_unstale":"2026-02-13T02:41:51.594356+0000","last_undegraded":"2026-02-13T02:41:51.594356+0000","last_fullsized":"2026-02-13T02:41:51.594356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:35.087843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594337+0000","last_change":"2026-02-13T02:41:50.600540+0000","last_active":"2026-02-13T02:41:51.594337+0000","last_peered":"2026-02-13T02:41:51.594337+0000","last_clean":"2026-02-13T02:41:51.594337+0000","last_became_active":"2026-02-13T02:41:50.600370+0000","last_became_peered":"2026-02-13T02:41:50.600370+0000","last_unstale":"2026-02-13T02:41:51.594337+0000","last_undegraded":"2026-02-13T02:41:51.594337+0000","last_fullsized":"2026-02-13T02:41:51.594337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:42.274036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753590+0000","last_change":"2026-02-13T02:41:50.602084+0000","last_active":"2026-02-13T02:41:51.753590+0000","last_peered":"2026-02-13T02:41:51.753590+0000","last_clean":"2026-02-13T02:41:51.753590+0000","last_became_active":"2026-02-13T02:41:50.601938+0000","last_became_peered":"2026-02-13T02:41:50.601938+0000","last_unstale":"2026-02-13T02:41:51.753590+0000","last_undegraded":"2026-02-13T02:41:51.753590+0000","last_fullsized":"2026-02-13T02:41:51.753590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:12:44.963129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638688+0000","last_change":"2026-02-13T02:41:50.602908+0000","last_active":"2026-02-13T02:41:51.638688+0000","last_peered":"2026-02-13T02:41:51.638688+0000","last_clean":"2026-02-13T02:41:51.638688+0000","last_became_active":"2026-02-13T02:41:50.602815+0000","last_became_peered":"2026-02-13T02:41:50.602815+0000","last_unstale":"2026-02-13T02:41:51.638688+0000","last_undegraded":"2026-02-13T02:41:51.638688+0000","last_fullsized":"2026-02-13T02:41:51.638688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:51:10.405979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621683+0000","last_change":"2026-02-13T02:41:49.595741+0000","last_active":"2026-02-13T02:41:54.621683+0000","last_peered":"2026-02-13T02:41:54.621683+0000","last_clean":"2026-02-13T02:41:54.621683+0000","last_became_active":"2026-02-13T02:41:49.595588+0000","last_became_peered":"2026-02-13T02:41:49.595588+0000","last_unstale":"2026-02-13T02:41:54.621683+0000","last_undegraded":"2026-02-13T02:41:54.621683+0000","last_fullsized":"2026-02-13T02:41:54.621683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:16.074126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594578+0000","last_change":"2026-02-13T02:41:50.604001+0000","last_active":"2026-02-13T02:41:51.594578+0000","last_peered":"2026-02-13T02:41:51.594578+0000","last_clean":"2026-02-13T02:41:51.594578+0000","last_became_active":"2026-02-13T02:41:50.603876+0000","last_became_peered":"2026-02-13T02:41:50.603876+0000","last_unstale":"2026-02-13T02:41:51.594578+0000","last_undegraded":"2026-02-13T02:41:51.594578+0000","last_fullsized":"2026-02-13T02:41:51.594578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:24:01.725748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.636482+0000","last_change":"2026-02-13T02:41:49.604405+0000","last_active":"2026-02-13T02:41:56.636482+0000","last_peered":"2026-02-13T02:41:56.636482+0000","last_clean":"2026-02-13T02:41:56.636482+0000","last_became_active":"2026-02-13T02:41:49.604257+0000","last_became_peered":"2026-02-13T02:41:49.604257+0000","last_unstale":"2026-02-13T02:41:56.636482+0000","last_undegraded":"2026-02-13T02:41:56.636482+0000","last_fullsized":"2026-02-13T02:41:56.636482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:45.835163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.630743+0000","last_change":"2026-02-13T02:41:49.601797+0000","last_active":"2026-02-13T02:41:55.630743+0000","last_peered":"2026-02-13T02:41:55.630743+0000","last_clean":"2026-02-13T02:41:55.630743+0000","last_became_active":"2026-02-13T02:41:49.601398+0000","last_became_peered":"2026-02-13T02:41:49.601398+0000","last_unstale":"2026-02-13T02:41:55.630743+0000","last_undegraded":"2026-02-13T02:41:55.630743+0000","last_fullsized":"2026-02-13T02:41:55.630743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:37.346955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596989+0000","last_change":"2026-02-13T02:41:50.606972+0000","last_active":"2026-02-13T02:41:51.596989+0000","last_peered":"2026-02-13T02:41:51.596989+0000","last_clean":"2026-02-13T02:41:51.596989+0000","last_became_active":"2026-02-13T02:41:50.606736+0000","last_became_peered":"2026-02-13T02:41:50.606736+0000","last_unstale":"2026-02-13T02:41:51.596989+0000","last_undegraded":"2026-02-13T02:41:51.596989+0000","last_fullsized":"2026-02-13T02:41:51.596989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:46.423039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621337+0000","last_change":"2026-02-13T02:41:49.595837+0000","last_active":"2026-02-13T02:41:54.621337+0000","last_peered":"2026-02-13T02:41:54.621337+0000","last_clean":"2026-02-13T02:41:54.621337+0000","last_became_active":"2026-02-13T02:41:49.595704+0000","last_became_peered":"2026-02-13T02:41:49.595704+0000","last_unstale":"2026-02-13T02:41:54.621337+0000","last_undegraded":"2026-02-13T02:41:54.621337+0000","last_fullsized":"2026-02-13T02:41:54.621337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:01:23.763609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756049+0000","last_change":"2026-02-13T02:41:50.611914+0000","last_active":"2026-02-13T02:41:51.756049+0000","last_peered":"2026-02-13T02:41:51.756049+0000","last_clean":"2026-02-13T02:41:51.756049+0000","last_became_active":"2026-02-13T02:41:50.611636+0000","last_became_peered":"2026-02-13T02:41:50.611636+0000","last_unstale":"2026-02-13T02:41:51.756049+0000","last_undegraded":"2026-02-13T02:41:51.756049+0000","last_fullsized":"2026-02-13T02:41:51.756049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:52:16.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.626018+0000","last_change":"2026-02-13T02:41:49.601592+0000","last_active":"2026-02-13T02:41:54.626018+0000","last_peered":"2026-02-13T02:41:54.626018+0000","last_clean":"2026-02-13T02:41:54.626018+0000","last_became_active":"2026-02-13T02:41:49.601466+0000","last_became_peered":"2026-02-13T02:41:49.601466+0000","last_unstale":"2026-02-13T02:41:54.626018+0000","last_undegraded":"2026-02-13T02:41:54.626018+0000","last_fullsized":"2026-02-13T02:41:54.626018+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:54.238406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756898+0000","last_change":"2026-02-13T02:41:50.605957+0000","last_active":"2026-02-13T02:41:51.756898+0000","last_peered":"2026-02-13T02:41:51.756898+0000","last_clean":"2026-02-13T02:41:51.756898+0000","last_became_active":"2026-02-13T02:41:50.605827+0000","last_became_peered":"2026-02-13T02:41:50.605827+0000","last_unstale":"2026-02-13T02:41:51.756898+0000","last_undegraded":"2026-02-13T02:41:51.756898+0000","last_fullsized":"2026-02-13T02:41:51.756898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:29.966443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643085+0000","last_change":"2026-02-13T02:41:49.599890+0000","last_active":"2026-02-13T02:41:57.643085+0000","last_peered":"2026-02-13T02:41:57.643085+0000","last_clean":"2026-02-13T02:41:57.643085+0000","last_became_active":"2026-02-13T02:41:49.599626+0000","last_became_peered":"2026-02-13T02:41:49.599626+0000","last_unstale":"2026-02-13T02:41:57.643085+0000","last_undegraded":"2026-02-13T02:41:57.643085+0000","last_fullsized":"2026-02-13T02:41:57.643085+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:27:44.242839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756712+0000","last_change":"2026-02-13T02:41:50.608740+0000","last_active":"2026-02-13T02:41:51.756712+0000","last_peered":"2026-02-13T02:41:51.756712+0000","last_clean":"2026-02-13T02:41:51.756712+0000","last_became_active":"2026-02-13T02:41:50.607195+0000","last_became_peered":"2026-02-13T02:41:50.607195+0000","last_unstale":"2026-02-13T02:41:51.756712+0000","last_undegraded":"2026-02-13T02:41:51.756712+0000","last_fullsized":"2026-02-13T02:41:51.756712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:44.460181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621624+0000","last_change":"2026-02-13T02:41:49.600637+0000","last_active":"2026-02-13T02:41:54.621624+0000","last_peered":"2026-02-13T02:41:54.621624+0000","last_clean":"2026-02-13T02:41:54.621624+0000","last_became_active":"2026-02-13T02:41:49.600502+0000","last_became_peered":"2026-02-13T02:41:49.600502+0000","last_unstale":"2026-02-13T02:41:54.621624+0000","last_undegraded":"2026-02-13T02:41:54.621624+0000","last_fullsized":"2026-02-13T02:41:54.621624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:42:59.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756802+0000","last_change":"2026-02-13T02:41:50.605595+0000","last_active":"2026-02-13T02:41:51.756802+0000","last_peered":"2026-02-13T02:41:51.756802+0000","last_clean":"2026-02-13T02:41:51.756802+0000","last_became_active":"2026-02-13T02:41:50.605404+0000","last_became_peered":"2026-02-13T02:41:50.605404+0000","last_unstale":"2026-02-13T02:41:51.756802+0000","last_undegraded":"2026-02-13T02:41:51.756802+0000","last_fullsized":"2026-02-13T02:41:51.756802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:15.374790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.622321+0000","last_change":"2026-02-13T02:41:49.600871+0000","last_active":"2026-02-13T02:41:54.622321+0000","last_peered":"2026-02-13T02:41:54.622321+0000","last_clean":"2026-02-13T02:41:54.622321+0000","last_became_active":"2026-02-13T02:41:49.600717+0000","last_became_peered":"2026-02-13T02:41:49.600717+0000","last_unstale":"2026-02-13T02:41:54.622321+0000","last_undegraded":"2026-02-13T02:41:54.622321+0000","last_fullsized":"2026-02-13T02:41:54.622321+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:03.550683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638813+0000","last_change":"2026-02-13T02:41:50.601869+0000","last_active":"2026-02-13T02:41:51.638813+0000","last_peered":"2026-02-13T02:41:51.638813+0000","last_clean":"2026-02-13T02:41:51.638813+0000","last_became_active":"2026-02-13T02:41:50.601753+0000","last_became_peered":"2026-02-13T02:41:50.601753+0000","last_unstale":"2026-02-13T02:41:51.638813+0000","last_undegraded":"2026-02-13T02:41:51.638813+0000","last_fullsized":"2026-02-13T02:41:51.638813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:53.246854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.626092+0000","last_change":"2026-02-13T02:41:49.605257+0000","last_active":"2026-02-13T02:41:55.626092+0000","last_peered":"2026-02-13T02:41:55.626092+0000","last_clean":"2026-02-13T02:41:55.626092+0000","last_became_active":"2026-02-13T02:41:49.605162+0000","last_became_peered":"2026-02-13T02:41:49.605162+0000","last_unstale":"2026-02-13T02:41:55.626092+0000","last_undegraded":"2026-02-13T02:41:55.626092+0000","last_fullsized":"2026-02-13T02:41:55.626092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:46.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756594+0000","last_change":"2026-02-13T02:41:50.608778+0000","last_active":"2026-02-13T02:41:51.756594+0000","last_peered":"2026-02-13T02:41:51.756594+0000","last_clean":"2026-02-13T02:41:51.756594+0000","last_became_active":"2026-02-13T02:41:50.608686+0000","last_became_peered":"2026-02-13T02:41:50.608686+0000","last_unstale":"2026-02-13T02:41:51.756594+0000","last_undegraded":"2026-02-13T02:41:51.756594+0000","last_fullsized":"2026-02-13T02:41:51.756594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:01.765041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.621642+0000","last_change":"2026-02-13T02:41:49.603081+0000","last_active":"2026-02-13T02:41:54.621642+0000","last_peered":"2026-02-13T02:41:54.621642+0000","last_clean":"2026-02-13T02:41:54.621642+0000","last_became_active":"2026-02-13T02:41:49.602818+0000","last_became_peered":"2026-02-13T02:41:49.602818+0000","last_unstale":"2026-02-13T02:41:54.621642+0000","last_undegraded":"2026-02-13T02:41:54.621642+0000","last_fullsized":"2026-02-13T02:41:54.621642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:55.523356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686167+0000","last_change":"2026-02-13T02:41:50.606663+0000","last_active":"2026-02-13T02:41:51.686167+0000","last_peered":"2026-02-13T02:41:51.686167+0000","last_clean":"2026-02-13T02:41:51.686167+0000","last_became_active":"2026-02-13T02:41:50.606460+0000","last_became_peered":"2026-02-13T02:41:50.606460+0000","last_unstale":"2026-02-13T02:41:51.686167+0000","last_undegraded":"2026-02-13T02:41:51.686167+0000","last_fullsized":"2026-02-13T02:41:51.686167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:23:24.744253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.647049+0000","last_change":"2026-02-13T02:41:49.597626+0000","last_active":"2026-02-13T02:41:58.647049+0000","last_peered":"2026-02-13T02:41:58.647049+0000","last_clean":"2026-02-13T02:41:58.647049+0000","last_became_active":"2026-02-13T02:41:49.597177+0000","last_became_peered":"2026-02-13T02:41:49.597177+0000","last_unstale":"2026-02-13T02:41:58.647049+0000","last_undegraded":"2026-02-13T02:41:58.647049+0000","last_fullsized":"2026-02-13T02:41:58.647049+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:43.194968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685920+0000","last_change":"2026-02-13T02:41:50.605190+0000","last_active":"2026-02-13T02:41:51.685920+0000","last_peered":"2026-02-13T02:41:51.685920+0000","last_clean":"2026-02-13T02:41:51.685920+0000","last_became_active":"2026-02-13T02:41:50.604929+0000","last_became_peered":"2026-02-13T02:41:50.604929+0000","last_unstale":"2026-02-13T02:41:51.685920+0000","last_undegraded":"2026-02-13T02:41:51.685920+0000","last_fullsized":"2026-02-13T02:41:51.685920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:41:19.216490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639971+0000","last_change":"2026-02-13T02:41:49.597710+0000","last_active":"2026-02-13T02:41:57.639971+0000","last_peered":"2026-02-13T02:41:57.639971+0000","last_clean":"2026-02-13T02:41:57.639971+0000","last_became_active":"2026-02-13T02:41:49.597545+0000","last_became_peered":"2026-02-13T02:41:49.597545+0000","last_unstale":"2026-02-13T02:41:57.639971+0000","last_undegraded":"2026-02-13T02:41:57.639971+0000","last_fullsized":"2026-02-13T02:41:57.639971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:40.978704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594383+0000","last_change":"2026-02-13T02:41:50.602185+0000","last_active":"2026-02-13T02:41:51.594383+0000","last_peered":"2026-02-13T02:41:51.594383+0000","last_clean":"2026-02-13T02:41:51.594383+0000","last_became_active":"2026-02-13T02:41:50.602029+0000","last_became_peered":"2026-02-13T02:41:50.602029+0000","last_unstale":"2026-02-13T02:41:51.594383+0000","last_undegraded":"2026-02-13T02:41:51.594383+0000","last_fullsized":"2026-02-13T02:41:51.594383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:44:46.598780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.624545+0000","last_change":"2026-02-13T02:41:49.596995+0000","last_active":"2026-02-13T02:41:57.624545+0000","last_peered":"2026-02-13T02:41:57.624545+0000","last_clean":"2026-02-13T02:41:57.624545+0000","last_became_active":"2026-02-13T02:41:49.596572+0000","last_became_peered":"2026-02-13T02:41:49.596572+0000","last_unstale":"2026-02-13T02:41:57.624545+0000","last_undegraded":"2026-02-13T02:41:57.624545+0000","last_fullsized":"2026-02-13T02:41:57.624545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:02.816921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753645+0000","last_change":"2026-02-13T02:41:50.600695+0000","last_active":"2026-02-13T02:41:51.753645+0000","last_peered":"2026-02-13T02:41:51.753645+0000","last_clean":"2026-02-13T02:41:51.753645+0000","last_became_active":"2026-02-13T02:41:50.600453+0000","last_became_peered":"2026-02-13T02:41:50.600453+0000","last_unstale":"2026-02-13T02:41:51.753645+0000","last_undegraded":"2026-02-13T02:41:51.753645+0000","last_fullsized":"2026-02-13T02:41:51.753645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:50:55.092606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643996+0000","last_change":"2026-02-13T02:41:49.607644+0000","last_active":"2026-02-13T02:41:57.643996+0000","last_peered":"2026-02-13T02:41:57.643996+0000","last_clean":"2026-02-13T02:41:57.643996+0000","last_became_active":"2026-02-13T02:41:49.607523+0000","last_became_peered":"2026-02-13T02:41:49.607523+0000","last_unstale":"2026-02-13T02:41:57.643996+0000","last_undegraded":"2026-02-13T02:41:57.643996+0000","last_fullsized":"2026-02-13T02:41:57.643996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:38.869550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686358+0000","last_change":"2026-02-13T02:41:50.603530+0000","last_active":"2026-02-13T02:41:51.686358+0000","last_peered":"2026-02-13T02:41:51.686358+0000","last_clean":"2026-02-13T02:41:51.686358+0000","last_became_active":"2026-02-13T02:41:50.603312+0000","last_became_peered":"2026-02-13T02:41:50.603312+0000","last_unstale":"2026-02-13T02:41:51.686358+0000","last_undegraded":"2026-02-13T02:41:51.686358+0000","last_fullsized":"2026-02-13T02:41:51.686358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:20.510472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.788830+0000","last_change":"2026-02-13T02:41:49.602974+0000","last_active":"2026-02-13T02:41:51.788830+0000","last_peered":"2026-02-13T02:41:51.788830+0000","last_clean":"2026-02-13T02:41:51.788830+0000","last_became_active":"2026-02-13T02:41:49.602734+0000","last_became_peered":"2026-02-13T02:41:49.602734+0000","last_unstale":"2026-02-13T02:41:51.788830+0000","last_undegraded":"2026-02-13T02:41:51.788830+0000","last_fullsized":"2026-02-13T02:41:51.788830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:55.811253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686213+0000","last_change":"2026-02-13T02:41:50.609569+0000","last_active":"2026-02-13T02:41:51.686213+0000","last_peered":"2026-02-13T02:41:51.686213+0000","last_clean":"2026-02-13T02:41:51.686213+0000","last_became_active":"2026-02-13T02:41:50.609385+0000","last_became_peered":"2026-02-13T02:41:50.609385+0000","last_unstale":"2026-02-13T02:41:51.686213+0000","last_undegraded":"2026-02-13T02:41:51.686213+0000","last_fullsized":"2026-02-13T02:41:51.686213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:01:38.361410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.632961+0000","last_change":"2026-02-13T02:41:49.597872+0000","last_active":"2026-02-13T02:41:56.632961+0000","last_peered":"2026-02-13T02:41:56.632961+0000","last_clean":"2026-02-13T02:41:56.632961+0000","last_became_active":"2026-02-13T02:41:49.597687+0000","last_became_peered":"2026-02-13T02:41:49.597687+0000","last_unstale":"2026-02-13T02:41:56.632961+0000","last_undegraded":"2026-02-13T02:41:56.632961+0000","last_fullsized":"2026-02-13T02:41:56.632961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:34:50.926874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686331+0000","last_change":"2026-02-13T02:41:50.603749+0000","last_active":"2026-02-13T02:41:51.686331+0000","last_peered":"2026-02-13T02:41:51.686331+0000","last_clean":"2026-02-13T02:41:51.686331+0000","last_became_active":"2026-02-13T02:41:50.603582+0000","last_became_peered":"2026-02-13T02:41:50.603582+0000","last_unstale":"2026-02-13T02:41:51.686331+0000","last_undegraded":"2026-02-13T02:41:51.686331+0000","last_fullsized":"2026-02-13T02:41:51.686331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:21:18.911738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686050+0000","last_change":"2026-02-13T02:41:25.005343+0000","last_active":"2026-02-13T02:41:51.686050+0000","last_peered":"2026-02-13T02:41:51.686050+0000","last_clean":"2026-02-13T02:41:51.686050+0000","last_became_active":"2026-02-13T02:41:25.005110+0000","last_became_peered":"2026-02-13T02:41:25.005110+0000","last_unstale":"2026-02-13T02:41:51.686050+0000","last_undegraded":"2026-02-13T02:41:51.686050+0000","last_fullsized":"2026-02-13T02:41:51.686050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_clean_scrub_stamp":"2026-02-13T02:40:11.017896+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:17.735016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.644630+0000","last_change":"2026-02-13T02:41:49.601087+0000","last_active":"2026-02-13T02:41:58.644630+0000","last_peered":"2026-02-13T02:41:58.644630+0000","last_clean":"2026-02-13T02:41:58.644630+0000","last_became_active":"2026-02-13T02:41:49.600937+0000","last_became_peered":"2026-02-13T02:41:49.600937+0000","last_unstale":"2026-02-13T02:41:58.644630+0000","last_undegraded":"2026-02-13T02:41:58.644630+0000","last_fullsized":"2026-02-13T02:41:58.644630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:00.587519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597194+0000","last_change":"2026-02-13T02:41:50.606319+0000","last_active":"2026-02-13T02:41:51.597194+0000","last_peered":"2026-02-13T02:41:51.597194+0000","last_clean":"2026-02-13T02:41:51.597194+0000","last_became_active":"2026-02-13T02:41:50.605323+0000","last_became_peered":"2026-02-13T02:41:50.605323+0000","last_unstale":"2026-02-13T02:41:51.597194+0000","last_undegraded":"2026-02-13T02:41:51.597194+0000","last_fullsized":"2026-02-13T02:41:51.597194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:30:37.743457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.629312+0000","last_change":"2026-02-13T02:41:49.599872+0000","last_active":"2026-02-13T02:41:55.629312+0000","last_peered":"2026-02-13T02:41:55.629312+0000","last_clean":"2026-02-13T02:41:55.629312+0000","last_became_active":"2026-02-13T02:41:49.599659+0000","last_became_peered":"2026-02-13T02:41:49.599659+0000","last_unstale":"2026-02-13T02:41:55.629312+0000","last_undegraded":"2026-02-13T02:41:55.629312+0000","last_fullsized":"2026-02-13T02:41:55.629312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:50:27.800392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755902+0000","last_change":"2026-02-13T02:41:50.604627+0000","last_active":"2026-02-13T02:41:51.755902+0000","last_peered":"2026-02-13T02:41:51.755902+0000","last_clean":"2026-02-13T02:41:51.755902+0000","last_became_active":"2026-02-13T02:41:50.604541+0000","last_became_peered":"2026-02-13T02:41:50.604541+0000","last_unstale":"2026-02-13T02:41:51.755902+0000","last_undegraded":"2026-02-13T02:41:51.755902+0000","last_fullsized":"2026-02-13T02:41:51.755902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:43.968495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.629944+0000","last_change":"2026-02-13T02:41:49.608418+0000","last_active":"2026-02-13T02:41:55.629944+0000","last_peered":"2026-02-13T02:41:55.629944+0000","last_clean":"2026-02-13T02:41:55.629944+0000","last_became_active":"2026-02-13T02:41:49.608146+0000","last_became_peered":"2026-02-13T02:41:49.608146+0000","last_unstale":"2026-02-13T02:41:55.629944+0000","last_undegraded":"2026-02-13T02:41:55.629944+0000","last_fullsized":"2026-02-13T02:41:55.629944+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:51.291825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594339+0000","last_change":"2026-02-13T02:41:50.601808+0000","last_active":"2026-02-13T02:41:51.594339+0000","last_peered":"2026-02-13T02:41:51.594339+0000","last_clean":"2026-02-13T02:41:51.594339+0000","last_became_active":"2026-02-13T02:41:50.601452+0000","last_became_peered":"2026-02-13T02:41:50.601452+0000","last_unstale":"2026-02-13T02:41:51.594339+0000","last_undegraded":"2026-02-13T02:41:51.594339+0000","last_fullsized":"2026-02-13T02:41:51.594339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:33.347585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.647998+0000","last_change":"2026-02-13T02:41:49.602005+0000","last_active":"2026-02-13T02:41:58.647998+0000","last_peered":"2026-02-13T02:41:58.647998+0000","last_clean":"2026-02-13T02:41:58.647998+0000","last_became_active":"2026-02-13T02:41:49.601849+0000","last_became_peered":"2026-02-13T02:41:49.601849+0000","last_unstale":"2026-02-13T02:41:58.647998+0000","last_undegraded":"2026-02-13T02:41:58.647998+0000","last_fullsized":"2026-02-13T02:41:58.647998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:41.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598520+0000","last_change":"2026-02-13T02:41:50.605183+0000","last_active":"2026-02-13T02:41:51.598520+0000","last_peered":"2026-02-13T02:41:51.598520+0000","last_clean":"2026-02-13T02:41:51.598520+0000","last_became_active":"2026-02-13T02:41:50.604957+0000","last_became_peered":"2026-02-13T02:41:50.604957+0000","last_unstale":"2026-02-13T02:41:51.598520+0000","last_undegraded":"2026-02-13T02:41:51.598520+0000","last_fullsized":"2026-02-13T02:41:51.598520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:11.673149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756117+0000","last_change":"2026-02-13T02:41:49.600325+0000","last_active":"2026-02-13T02:41:51.756117+0000","last_peered":"2026-02-13T02:41:51.756117+0000","last_clean":"2026-02-13T02:41:51.756117+0000","last_became_active":"2026-02-13T02:41:49.600224+0000","last_became_peered":"2026-02-13T02:41:49.600224+0000","last_unstale":"2026-02-13T02:41:51.756117+0000","last_undegraded":"2026-02-13T02:41:51.756117+0000","last_fullsized":"2026-02-13T02:41:51.756117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:54.322610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598571+0000","last_change":"2026-02-13T02:41:50.606498+0000","last_active":"2026-02-13T02:41:51.598571+0000","last_peered":"2026-02-13T02:41:51.598571+0000","last_clean":"2026-02-13T02:41:51.598571+0000","last_became_active":"2026-02-13T02:41:50.606363+0000","last_became_peered":"2026-02-13T02:41:50.606363+0000","last_unstale":"2026-02-13T02:41:51.598571+0000","last_undegraded":"2026-02-13T02:41:51.598571+0000","last_fullsized":"2026-02-13T02:41:51.598571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:01:26.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.642011+0000","last_change":"2026-02-13T02:41:49.598219+0000","last_active":"2026-02-13T02:41:57.642011+0000","last_peered":"2026-02-13T02:41:57.642011+0000","last_clean":"2026-02-13T02:41:57.642011+0000","last_became_active":"2026-02-13T02:41:49.598085+0000","last_became_peered":"2026-02-13T02:41:49.598085+0000","last_unstale":"2026-02-13T02:41:57.642011+0000","last_undegraded":"2026-02-13T02:41:57.642011+0000","last_fullsized":"2026-02-13T02:41:57.642011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:57.092957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756305+0000","last_change":"2026-02-13T02:41:50.608035+0000","last_active":"2026-02-13T02:41:51.756305+0000","last_peered":"2026-02-13T02:41:51.756305+0000","last_clean":"2026-02-13T02:41:51.756305+0000","last_became_active":"2026-02-13T02:41:50.607792+0000","last_became_peered":"2026-02-13T02:41:50.607792+0000","last_unstale":"2026-02-13T02:41:51.756305+0000","last_undegraded":"2026-02-13T02:41:51.756305+0000","last_fullsized":"2026-02-13T02:41:51.756305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:54.002715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'9","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.036888+0000","last_change":"2026-02-13T02:41:49.607784+0000","last_active":"2026-02-13T02:41:58.036888+0000","last_peered":"2026-02-13T02:41:58.036888+0000","last_clean":"2026-02-13T02:41:58.036888+0000","last_became_active":"2026-02-13T02:41:49.607602+0000","last_became_peered":"2026-02-13T02:41:49.607602+0000","last_unstale":"2026-02-13T02:41:58.036888+0000","last_undegraded":"2026-02-13T02:41:58.036888+0000","last_fullsized":"2026-02-13T02:41:58.036888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:36.215383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597453+0000","last_change":"2026-02-13T02:41:50.607352+0000","last_active":"2026-02-13T02:41:51.597453+0000","last_peered":"2026-02-13T02:41:51.597453+0000","last_clean":"2026-02-13T02:41:51.597453+0000","last_became_active":"2026-02-13T02:41:50.607212+0000","last_became_peered":"2026-02-13T02:41:50.607212+0000","last_unstale":"2026-02-13T02:41:51.597453+0000","last_undegraded":"2026-02-13T02:41:51.597453+0000","last_fullsized":"2026-02-13T02:41:51.597453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:52.063018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643960+0000","last_change":"2026-02-13T02:41:49.600639+0000","last_active":"2026-02-13T02:41:57.643960+0000","last_peered":"2026-02-13T02:41:57.643960+0000","last_clean":"2026-02-13T02:41:57.643960+0000","last_became_active":"2026-02-13T02:41:49.600493+0000","last_became_peered":"2026-02-13T02:41:49.600493+0000","last_unstale":"2026-02-13T02:41:57.643960+0000","last_undegraded":"2026-02-13T02:41:57.643960+0000","last_fullsized":"2026-02-13T02:41:57.643960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:49:51.847533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756691+0000","last_change":"2026-02-13T02:41:50.608701+0000","last_active":"2026-02-13T02:41:51.756691+0000","last_peered":"2026-02-13T02:41:51.756691+0000","last_clean":"2026-02-13T02:41:51.756691+0000","last_became_active":"2026-02-13T02:41:50.608587+0000","last_became_peered":"2026-02-13T02:41:50.608587+0000","last_unstale":"2026-02-13T02:41:51.756691+0000","last_undegraded":"2026-02-13T02:41:51.756691+0000","last_fullsized":"2026-02-13T02:41:51.756691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:51.204751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.623861+0000","last_change":"2026-02-13T02:41:49.603944+0000","last_active":"2026-02-13T02:41:54.623861+0000","last_peered":"2026-02-13T02:41:54.623861+0000","last_clean":"2026-02-13T02:41:54.623861+0000","last_became_active":"2026-02-13T02:41:49.603771+0000","last_became_peered":"2026-02-13T02:41:49.603771+0000","last_unstale":"2026-02-13T02:41:54.623861+0000","last_undegraded":"2026-02-13T02:41:54.623861+0000","last_fullsized":"2026-02-13T02:41:54.623861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:02.938077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638571+0000","last_change":"2026-02-13T02:41:50.600369+0000","last_active":"2026-02-13T02:41:51.638571+0000","last_peered":"2026-02-13T02:41:51.638571+0000","last_clean":"2026-02-13T02:41:51.638571+0000","last_became_active":"2026-02-13T02:41:50.600236+0000","last_became_peered":"2026-02-13T02:41:50.600236+0000","last_unstale":"2026-02-13T02:41:51.638571+0000","last_undegraded":"2026-02-13T02:41:51.638571+0000","last_fullsized":"2026-02-13T02:41:51.638571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:33.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.636786+0000","last_change":"2026-02-13T02:41:49.606756+0000","last_active":"2026-02-13T02:41:56.636786+0000","last_peered":"2026-02-13T02:41:56.636786+0000","last_clean":"2026-02-13T02:41:56.636786+0000","last_became_active":"2026-02-13T02:41:49.606577+0000","last_became_peered":"2026-02-13T02:41:49.606577+0000","last_unstale":"2026-02-13T02:41:56.636786+0000","last_undegraded":"2026-02-13T02:41:56.636786+0000","last_fullsized":"2026-02-13T02:41:56.636786+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:22.336094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753650+0000","last_change":"2026-02-13T02:41:50.596967+0000","last_active":"2026-02-13T02:41:51.753650+0000","last_peered":"2026-02-13T02:41:51.753650+0000","last_clean":"2026-02-13T02:41:51.753650+0000","last_became_active":"2026-02-13T02:41:50.596798+0000","last_became_peered":"2026-02-13T02:41:50.596798+0000","last_unstale":"2026-02-13T02:41:51.753650+0000","last_undegraded":"2026-02-13T02:41:51.753650+0000","last_fullsized":"2026-02-13T02:41:51.753650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:46.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.618957+0000","last_change":"2026-02-13T02:41:49.605314+0000","last_active":"2026-02-13T02:41:56.618957+0000","last_peered":"2026-02-13T02:41:56.618957+0000","last_clean":"2026-02-13T02:41:56.618957+0000","last_became_active":"2026-02-13T02:41:49.605183+0000","last_became_peered":"2026-02-13T02:41:49.605183+0000","last_unstale":"2026-02-13T02:41:56.618957+0000","last_undegraded":"2026-02-13T02:41:56.618957+0000","last_fullsized":"2026-02-13T02:41:56.618957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:55.197111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597243+0000","last_change":"2026-02-13T02:41:50.605693+0000","last_active":"2026-02-13T02:41:51.597243+0000","last_peered":"2026-02-13T02:41:51.597243+0000","last_clean":"2026-02-13T02:41:51.597243+0000","last_became_active":"2026-02-13T02:41:50.605095+0000","last_became_peered":"2026-02-13T02:41:50.605095+0000","last_unstale":"2026-02-13T02:41:51.597243+0000","last_undegraded":"2026-02-13T02:41:51.597243+0000","last_fullsized":"2026-02-13T02:41:51.597243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:20.729194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.620279+0000","last_change":"2026-02-13T02:41:49.597243+0000","last_active":"2026-02-13T02:41:54.620279+0000","last_peered":"2026-02-13T02:41:54.620279+0000","last_clean":"2026-02-13T02:41:54.620279+0000","last_became_active":"2026-02-13T02:41:49.596866+0000","last_became_peered":"2026-02-13T02:41:49.596866+0000","last_unstale":"2026-02-13T02:41:54.620279+0000","last_undegraded":"2026-02-13T02:41:54.620279+0000","last_fullsized":"2026-02-13T02:41:54.620279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:29:38.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686068+0000","last_change":"2026-02-13T02:41:50.606794+0000","last_active":"2026-02-13T02:41:51.686068+0000","last_peered":"2026-02-13T02:41:51.686068+0000","last_clean":"2026-02-13T02:41:51.686068+0000","last_became_active":"2026-02-13T02:41:50.606595+0000","last_became_peered":"2026-02-13T02:41:50.606595+0000","last_unstale":"2026-02-13T02:41:51.686068+0000","last_undegraded":"2026-02-13T02:41:51.686068+0000","last_fullsized":"2026-02-13T02:41:51.686068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:24.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594579+0000","last_change":"2026-02-13T02:41:50.602019+0000","last_active":"2026-02-13T02:41:51.594579+0000","last_peered":"2026-02-13T02:41:51.594579+0000","last_clean":"2026-02-13T02:41:51.594579+0000","last_became_active":"2026-02-13T02:41:50.601731+0000","last_became_peered":"2026-02-13T02:41:50.601731+0000","last_unstale":"2026-02-13T02:41:51.594579+0000","last_undegraded":"2026-02-13T02:41:51.594579+0000","last_fullsized":"2026-02-13T02:41:51.594579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:19.211804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639877+0000","last_change":"2026-02-13T02:41:49.596759+0000","last_active":"2026-02-13T02:41:57.639877+0000","last_peered":"2026-02-13T02:41:57.639877+0000","last_clean":"2026-02-13T02:41:57.639877+0000","last_became_active":"2026-02-13T02:41:49.596314+0000","last_became_peered":"2026-02-13T02:41:49.596314+0000","last_unstale":"2026-02-13T02:41:57.639877+0000","last_undegraded":"2026-02-13T02:41:57.639877+0000","last_fullsized":"2026-02-13T02:41:57.639877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:20:20.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756768+0000","last_change":"2026-02-13T02:41:50.605832+0000","last_active":"2026-02-13T02:41:51.756768+0000","last_peered":"2026-02-13T02:41:51.756768+0000","last_clean":"2026-02-13T02:41:51.756768+0000","last_became_active":"2026-02-13T02:41:50.605574+0000","last_became_peered":"2026-02-13T02:41:50.605574+0000","last_unstale":"2026-02-13T02:41:51.756768+0000","last_undegraded":"2026-02-13T02:41:51.756768+0000","last_fullsized":"2026-02-13T02:41:51.756768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:33:32.847010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.638633+0000","last_change":"2026-02-13T02:41:49.596987+0000","last_active":"2026-02-13T02:41:58.638633+0000","last_peered":"2026-02-13T02:41:58.638633+0000","last_clean":"2026-02-13T02:41:58.638633+0000","last_became_active":"2026-02-13T02:41:49.596599+0000","last_became_peered":"2026-02-13T02:41:49.596599+0000","last_unstale":"2026-02-13T02:41:58.638633+0000","last_undegraded":"2026-02-13T02:41:58.638633+0000","last_fullsized":"2026-02-13T02:41:58.638633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:30.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756702+0000","last_change":"2026-02-13T02:41:50.610429+0000","last_active":"2026-02-13T02:41:51.756702+0000","last_peered":"2026-02-13T02:41:51.756702+0000","last_clean":"2026-02-13T02:41:51.756702+0000","last_became_active":"2026-02-13T02:41:50.610239+0000","last_became_peered":"2026-02-13T02:41:50.610239+0000","last_unstale":"2026-02-13T02:41:51.756702+0000","last_undegraded":"2026-02-13T02:41:51.756702+0000","last_fullsized":"2026-02-13T02:41:51.756702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:40.272140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:52.062405+0000","last_change":"2026-02-13T02:41:49.606193+0000","last_active":"2026-02-13T02:41:52.062405+0000","last_peered":"2026-02-13T02:41:52.062405+0000","last_clean":"2026-02-13T02:41:52.062405+0000","last_became_active":"2026-02-13T02:41:49.606085+0000","last_became_peered":"2026-02-13T02:41:49.606085+0000","last_unstale":"2026-02-13T02:41:52.062405+0000","last_undegraded":"2026-02-13T02:41:52.062405+0000","last_fullsized":"2026-02-13T02:41:52.062405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:49:14.551780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597364+0000","last_change":"2026-02-13T02:41:50.608679+0000","last_active":"2026-02-13T02:41:51.597364+0000","last_peered":"2026-02-13T02:41:51.597364+0000","last_clean":"2026-02-13T02:41:51.597364+0000","last_became_active":"2026-02-13T02:41:50.607474+0000","last_became_peered":"2026-02-13T02:41:50.607474+0000","last_unstale":"2026-02-13T02:41:51.597364+0000","last_undegraded":"2026-02-13T02:41:51.597364+0000","last_fullsized":"2026-02-13T02:41:51.597364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:49:25.463410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.645168+0000","last_change":"2026-02-13T02:41:49.599289+0000","last_active":"2026-02-13T02:41:58.645168+0000","last_peered":"2026-02-13T02:41:58.645168+0000","last_clean":"2026-02-13T02:41:58.645168+0000","last_became_active":"2026-02-13T02:41:49.598567+0000","last_became_peered":"2026-02-13T02:41:49.598567+0000","last_unstale":"2026-02-13T02:41:58.645168+0000","last_undegraded":"2026-02-13T02:41:58.645168+0000","last_fullsized":"2026-02-13T02:41:58.645168+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:23.527572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8576,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":22,"num_read_kb":19,"num_write":199,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":61,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":49848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":293644,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264489,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710728,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":399099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939656,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":991077,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":25731,"internal_metadata":27564925},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103179,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":398619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32442,"internal_metadata":27558214},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332109,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":399019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32992,"internal_metadata":27557664},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561038,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":991966,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34554,"internal_metadata":27556102},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691855,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":398197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34870,"internal_metadata":27555786},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920785,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":989341,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":27642,"internal_metadata":27563014},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051603,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":398585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43851,"internal_metadata":27546805},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280533,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":397759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43918,"internal_metadata":27546738},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":56,"kb_used_meta":26887,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":400481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57502,"internal_metadata":27533154},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640280,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":424865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45723,"internal_metadata":27544933},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":400107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50354,"internal_metadata":27540302},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11364,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":27390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2724,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":56417,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43431,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26177,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9340,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11905,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32965,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31071,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31332,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30954,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5964,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:42:02.699 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T02:42:02.700 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T02:42:02.700 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T02:42:02.751 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:02 trial078 ceph-mon[22944]: pgmap v183: 97 pgs: 97 active+clean; 585 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2026-02-13T02:42:02.884 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:02.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:02 trial091 ceph-mon[27614]: pgmap v183: 97 pgs: 97 active+clean; 585 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2026-02-13T02:42:03.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:02 trial154 ceph-mon[27921]: pgmap v183: 97 pgs: 97 active+clean; 585 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 6.6 KiB/s wr, 22 op/s 2026-02-13T02:42:03.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 -- 10.20.193.78:0/3877020022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c115410 msgr2=0x7f6b0c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 --2- 10.20.193.78:0/3877020022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c115410 0x7f6b0c175db0 secure :-1 s=READY pgs=175 gs=2 cs=0 l=1 c_cookie=3719661938134161379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b0000a9b0 tx=0x7f6b0002fd20 comp rx=0 tx=0).stop 2026-02-13T02:42:03.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 -- 10.20.193.78:0/3877020022 shutdown_connections 2026-02-13T02:42:03.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 --2- 10.20.193.78:0/3877020022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c115410 0x7f6b0c175db0 unknown :-1 s=CLOSED pgs=175 gs=2 cs=0 l=1 c_cookie=3719661938134161379 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 --2- 10.20.193.78:0/3877020022 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c10fbf0 0x7f6b0c114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 --2- 10.20.193.78:0/3877020022 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b0c10f200 0x7f6b0c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 -- 10.20.193.78:0/3877020022 >> 10.20.193.78:0/3877020022 conn(0x7f6b0c0ecb00 msgr2=0x7f6b0c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:03.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.080+0000 7f6b122786c0 1 -- 10.20.193.78:0/3877020022 shutdown_connections 2026-02-13T02:42:03.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.081+0000 7f6b122786c0 1 -- 10.20.193.78:0/3877020022 wait complete. 2026-02-13T02:42:03.086 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 Processor -- start 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 -- start start 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b0c10f200 0x7f6b0c11d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c115410 0x7f6b0c11d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c122a70 0x7f6b0c122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c123480 con 0x7f6b0c122a70 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c1235f0 con 0x7f6b0c10f200 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b122786c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c1237b0 con 0x7f6b0c115410 2026-02-13T02:42:03.087 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b0affd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c115410 0x7f6b0c11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b0b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b0c10f200 0x7f6b0c11d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b0bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c122a70 0x7f6b0c122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b0affd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c115410 0x7f6b0c11d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:52814/0 (socket says 10.20.193.78:52814) 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.082+0000 7f6b0affd6c0 1 -- 10.20.193.78:0/1841431854 learned_addr learned my addr 10.20.193.78:0/1841431854 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b0affd6c0 1 -- 10.20.193.78:0/1841431854 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b0c10f200 msgr2=0x7f6b0c11d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b0affd6c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b0c10f200 0x7f6b0c11d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b0affd6c0 1 -- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c122a70 msgr2=0x7f6b0c122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b0affd6c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c122a70 0x7f6b0c122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b0affd6c0 1 -- 10.20.193.78:0/1841431854 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0000a5b0 con 0x7f6b0c115410 2026-02-13T02:42:03.088 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b0affd6c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c115410 0x7f6b0c11d6b0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6afc00b750 tx=0x7f6afc00bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:03.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b08ff96c0 1 -- 10.20.193.78:0/1841431854 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6afc004a80 con 0x7f6b0c115410 2026-02-13T02:42:03.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b08ff96c0 1 -- 10.20.193.78:0/1841431854 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6afc009030 con 0x7f6b0c115410 2026-02-13T02:42:03.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c163c60 con 0x7f6b0c115410 2026-02-13T02:42:03.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b08ff96c0 1 -- 10.20.193.78:0/1841431854 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6afc00cdb0 con 0x7f6b0c115410 2026-02-13T02:42:03.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c1640f0 con 0x7f6b0c115410 2026-02-13T02:42:03.089 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.083+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c1104d0 con 0x7f6b0c115410 2026-02-13T02:42:03.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.085+0000 7f6b08ff96c0 1 -- 10.20.193.78:0/1841431854 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6afc005000 con 0x7f6b0c115410 2026-02-13T02:42:03.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.087+0000 7f6b08ff96c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ae00b56e0 0x7f6ae00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.087+0000 7f6b08ff96c0 1 -- 10.20.193.78:0/1841431854 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f6afc0e3ab0 con 0x7f6b0c115410 2026-02-13T02:42:03.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.087+0000 7f6b08ff96c0 1 -- 10.20.193.78:0/1841431854 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6afc11c5e0 con 0x7f6b0c115410 2026-02-13T02:42:03.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.087+0000 7f6b0b7fe6c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ae00b56e0 0x7f6ae00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:03.090 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.088+0000 7f6b0b7fe6c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ae00b56e0 0x7f6ae00d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6af8005b40 tx=0x7f6af8009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:03.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.223+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6b0c10f5d0 con 0x7f6b0c115410 2026-02-13T02:42:03.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.226+0000 7f6b08ff96c0 1 -- 10.20.193.78:0/1841431854 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f6afc0a6400 con 0x7f6b0c115410 2026-02-13T02:42:03.227 INFO:teuthology.orchestra.run.trial078.stdout:[client.0] 2026-02-13T02:42:03.227 INFO:teuthology.orchestra.run.trial078.stdout: key = AQB7j45pb11nDRAAoTVwbakw86z7fVC7cR0zSw== 2026-02-13T02:42:03.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ae00b56e0 msgr2=0x7f6ae00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ae00b56e0 0x7f6ae00d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6af8005b40 tx=0x7f6af8009310 comp rx=0 tx=0).stop 2026-02-13T02:42:03.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c115410 msgr2=0x7f6b0c11d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c115410 0x7f6b0c11d6b0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6afc00b750 tx=0x7f6afc00bc20 comp rx=0 tx=0).stop 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 shutdown_connections 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6ae00b56e0 0x7f6ae00d5b90 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b0c122a70 0x7f6b0c122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b0c115410 0x7f6b0c11d6b0 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 --2- 10.20.193.78:0/1841431854 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b0c10f200 0x7f6b0c11d170 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 >> 10.20.193.78:0/1841431854 conn(0x7f6b0c0ecb00 msgr2=0x7f6b0c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 shutdown_connections 2026-02-13T02:42:03.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.227+0000 7f6b122786c0 1 -- 10.20.193.78:0/1841431854 wait complete. 2026-02-13T02:42:03.330 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:42:03.331 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T02:42:03.331 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T02:42:03.409 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T02:42:03.630 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:03.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/4120062115 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc010f060 msgr2=0x7f9dc010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/4120062115 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc010f060 0x7f9dc010f430 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=17948845204586080080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9db0009970 tx=0x7f9db002ed10 comp rx=0 tx=0).stop 2026-02-13T02:42:03.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/4120062115 shutdown_connections 2026-02-13T02:42:03.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/4120062115 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dc0115270 0x7f9dc0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/4120062115 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dc010fa50 0x7f9dc0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/4120062115 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc010f060 0x7f9dc010f430 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=17948845204586080080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/4120062115 >> 10.20.193.78:0/4120062115 conn(0x7f9dc00ec980 msgr2=0x7f9dc010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:03.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/4120062115 shutdown_connections 2026-02-13T02:42:03.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/4120062115 wait complete. 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.819+0000 7f9dc70a76c0 1 Processor -- start 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc70a76c0 1 -- start start 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc70a76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dc010f060 0x7f9dc011cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc70a76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dc0115270 0x7f9dc011d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc70a76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc01228b0 0x7f9dc0122d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc70a76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01232c0 con 0x7f9dc0115270 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc70a76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0123430 con 0x7f9dc01228b0 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc70a76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01235f0 con 0x7f9dc010f060 2026-02-13T02:42:03.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc01228b0 0x7f9dc0122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc01228b0 0x7f9dc0122d50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:52936/0 (socket says 10.20.193.78:52936) 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 -- 10.20.193.78:0/1243152066 learned_addr learned my addr 10.20.193.78:0/1243152066 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc58a46c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dc0115270 0x7f9dc011d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 -- 10.20.193.78:0/1243152066 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dc010f060 msgr2=0x7f9dc011cfb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dc010f060 0x7f9dc011cfb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 -- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dc0115270 msgr2=0x7f9dc011d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dc0115270 0x7f9dc011d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc68a66c0 1 -- 10.20.193.78:0/1243152066 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc00a5b0 con 0x7f9dc01228b0 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.820+0000 7f9dc58a46c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dc0115270 0x7f9dc011d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.821+0000 7f9dc68a66c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc01228b0 0x7f9dc0122d50 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dbc00a820 tx=0x7f9dbc00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:03.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.821+0000 7f9da77fe6c0 1 -- 10.20.193.78:0/1243152066 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9dbc003c40 con 0x7f9dc01228b0 2026-02-13T02:42:03.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.821+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db0009590 con 0x7f9dc01228b0 2026-02-13T02:42:03.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.821+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc0163df0 con 0x7f9dc01228b0 2026-02-13T02:42:03.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.821+0000 7f9da77fe6c0 1 -- 10.20.193.78:0/1243152066 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9dbc00a070 con 0x7f9dc01228b0 2026-02-13T02:42:03.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.821+0000 7f9da77fe6c0 1 -- 10.20.193.78:0/1243152066 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9dbc003c40 con 0x7f9dc01228b0 2026-02-13T02:42:03.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.821+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc0110330 con 0x7f9dc01228b0 2026-02-13T02:42:03.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.823+0000 7f9da77fe6c0 1 -- 10.20.193.78:0/1243152066 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9dbc005030 con 0x7f9dc01228b0 2026-02-13T02:42:03.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.825+0000 7f9da77fe6c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d9c0b57c0 0x7f9d9c0d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:03.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.825+0000 7f9da77fe6c0 1 -- 10.20.193.78:0/1243152066 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9dbc0e4b10 con 0x7f9dc01228b0 2026-02-13T02:42:03.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.825+0000 7f9dc60a56c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d9c0b57c0 0x7f9d9c0d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:03.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.825+0000 7f9da77fe6c0 1 -- 10.20.193.78:0/1243152066 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9dbc0a7460 con 0x7f9dc01228b0 2026-02-13T02:42:03.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.826+0000 7f9dc60a56c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d9c0b57c0 0x7f9d9c0d5c70 secure :-1 s=READY pgs=153 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9db00098c0 tx=0x7f9db00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:03.927 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.925+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9dc011e100 con 0x7f9dc01228b0 2026-02-13T02:42:03.927 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:03 trial078 ceph-mon[22944]: from='client.24809 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:03.927 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:03 trial078 ceph-mon[22944]: from='client.24815 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:03.927 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1841431854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:42:03.928 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:03 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:42:03.928 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:03 trial078 ceph-mon[22944]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T02:42:03.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.925+0000 7f9da77fe6c0 1 -- 10.20.193.78:0/1243152066 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7f9dbc0aa610 con 0x7f9dc01228b0 2026-02-13T02:42:03.929 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:03.929 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d9c0b57c0 msgr2=0x7f9d9c0d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d9c0b57c0 0x7f9d9c0d5c70 secure :-1 s=READY pgs=153 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9db00098c0 tx=0x7f9db00023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc01228b0 msgr2=0x7f9dc0122d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc01228b0 0x7f9dc0122d50 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dbc00a820 tx=0x7f9dbc00ce50 comp rx=0 tx=0).stop 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 shutdown_connections 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d9c0b57c0 0x7f9d9c0d5c70 unknown :-1 s=CLOSED pgs=153 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dc01228b0 0x7f9dc0122d50 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dc0115270 0x7f9dc011d4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 --2- 10.20.193.78:0/1243152066 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dc010f060 0x7f9dc011cfb0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.926+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 >> 10.20.193.78:0/1243152066 conn(0x7f9dc00ec980 msgr2=0x7f9dc010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:03.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.927+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 shutdown_connections 2026-02-13T02:42:03.931 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:03.927+0000 7f9dc70a76c0 1 -- 10.20.193.78:0/1243152066 wait complete. 2026-02-13T02:42:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:03 trial091 ceph-mon[27614]: from='client.24809 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:03 trial091 ceph-mon[27614]: from='client.24815 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1841431854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:42:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:03 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:42:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:03 trial091 ceph-mon[27614]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T02:42:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:03 trial154 ceph-mon[27921]: from='client.24809 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:03 trial154 ceph-mon[27921]: from='client.24815 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1841431854' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:42:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:03 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:42:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:03 trial154 ceph-mon[27921]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T02:42:04.031 INFO:teuthology.orchestra.run.trial078.stdout:[{"version":49,"timestamp":"2026-02-13T02:41:44.882674+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T02:42:04.031 INFO:tasks.ceph_manager:config epoch is 49 2026-02-13T02:42:04.032 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T02:42:04.032 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T02:42:04.032 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T02:42:04.217 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/2308810755 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10c680 msgr2=0x7f6d3c1116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/2308810755 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10c680 0x7f6d3c1116c0 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=17084981282702203178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d30009970 tx=0x7f6d3002ed10 comp rx=0 tx=0).stop 2026-02-13T02:42:04.402 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/2308810755 shutdown_connections 2026-02-13T02:42:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/2308810755 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6d3c111ea0 0x7f6d3c172840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/2308810755 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10c680 0x7f6d3c1116c0 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=17084981282702203178 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/2308810755 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d3c10bc90 0x7f6d3c10c060 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/2308810755 >> 10.20.193.78:0/2308810755 conn(0x7f6d3c0e9590 msgr2=0x7f6d3c1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/2308810755 shutdown_connections 2026-02-13T02:42:04.403 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.400+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/2308810755 wait complete. 2026-02-13T02:42:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 Processor -- start 2026-02-13T02:42:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 -- start start 2026-02-13T02:42:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10bc90 0x7f6d3c114d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6d3c111ea0 0x7f6d3c115250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d3c11a610 0x7f6d3c11aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:04.405 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c11b020 con 0x7f6d3c111ea0 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c11b190 con 0x7f6d3c10bc90 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d433cb6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c11b350 con 0x7f6d3c11a610 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d423c96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10bc90 0x7f6d3c114d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d423c96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10bc90 0x7f6d3c114d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:52952/0 (socket says 10.20.193.78:52952) 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d423c96c0 1 -- 10.20.193.78:0/327098182 learned_addr learned my addr 10.20.193.78:0/327098182 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d41bc86c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6d3c111ea0 0x7f6d3c115250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.401+0000 7f6d42bca6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d3c11a610 0x7f6d3c11aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d41bc86c0 1 -- 10.20.193.78:0/327098182 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d3c11a610 msgr2=0x7f6d3c11aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d41bc86c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d3c11a610 0x7f6d3c11aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d41bc86c0 1 -- 10.20.193.78:0/327098182 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10bc90 msgr2=0x7f6d3c114d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:04.406 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d41bc86c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10bc90 0x7f6d3c114d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d41bc86c0 1 -- 10.20.193.78:0/327098182 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d30009590 con 0x7f6d3c111ea0 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d423c96c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10bc90 0x7f6d3c114d10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d41bc86c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6d3c111ea0 0x7f6d3c115250 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3c055f10 tx=0x7f6d3002fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d237fe6c0 1 -- 10.20.193.78:0/327098182 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d30002ae0 con 0x7f6d3c111ea0 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d237fe6c0 1 -- 10.20.193.78:0/327098182 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6d300046b0 con 0x7f6d3c111ea0 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d237fe6c0 1 -- 10.20.193.78:0/327098182 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d30037070 con 0x7f6d3c111ea0 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c15b7a0 con 0x7f6d3c111ea0 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.402+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c15bbd0 con 0x7f6d3c111ea0 2026-02-13T02:42:04.407 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.403+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c10cf60 con 0x7f6d3c111ea0 2026-02-13T02:42:04.408 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.405+0000 7f6d237fe6c0 1 -- 10.20.193.78:0/327098182 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6d30007260 con 0x7f6d3c111ea0 2026-02-13T02:42:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.407+0000 7f6d237fe6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6d180b5830 0x7f6d180d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.407+0000 7f6d237fe6c0 1 -- 10.20.193.78:0/327098182 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f6d30107bc0 con 0x7f6d3c111ea0 2026-02-13T02:42:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.407+0000 7f6d237fe6c0 1 -- 10.20.193.78:0/327098182 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d30140620 con 0x7f6d3c111ea0 2026-02-13T02:42:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.407+0000 7f6d423c96c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6d180b5830 0x7f6d180d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:04.409 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.408+0000 7f6d423c96c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6d180b5830 0x7f6d180d5ce0 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d2c0095e0 tx=0x7f6d2c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:04.535 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.533+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6d3c115e60 con 0x7f6d3c111ea0 2026-02-13T02:42:04.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.537+0000 7f6d237fe6c0 1 -- 10.20.193.78:0/327098182 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) ==== 74+0+297595 (secure 0 0 0) 0x7f6d300ca510 con 0x7f6d3c111ea0 2026-02-13T02:42:04.543 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6d180b5830 msgr2=0x7f6d180d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6d180b5830 0x7f6d180d5ce0 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d2c0095e0 tx=0x7f6d2c009260 comp rx=0 tx=0).stop 2026-02-13T02:42:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6d3c111ea0 msgr2=0x7f6d3c115250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:04.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6d3c111ea0 0x7f6d3c115250 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3c055f10 tx=0x7f6d3002fc20 comp rx=0 tx=0).stop 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 shutdown_connections 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6d180b5830 0x7f6d180d5ce0 unknown :-1 s=CLOSED pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d3c11a610 0x7f6d3c11aab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6d3c111ea0 0x7f6d3c115250 unknown :-1 s=CLOSED pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 --2- 10.20.193.78:0/327098182 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d3c10bc90 0x7f6d3c114d10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 >> 10.20.193.78:0/327098182 conn(0x7f6d3c0e9590 msgr2=0x7f6d3c109970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 shutdown_connections 2026-02-13T02:42:04.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:04.540+0000 7f6d433cb6c0 1 -- 10.20.193.78:0/327098182 wait complete. 2026-02-13T02:42:04.644 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":16,"flags":0,"active_gid":14187,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6800","nonce":1569498056},{"type":"v1","addr":"10.20.193.78:6801","nonce":1569498056}]},"active_addr":"10.20.193.78:6801/1569498056","active_change":"2026-02-13T02:39:34.790639+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":24257,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24259,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":4,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":2821120002}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":1349483067}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":3558333746}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":2727362959}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.78:0","nonce":1991119078}]}]} 2026-02-13T02:42:04.656 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T02:42:04.656 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T02:42:04.656 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:42:04.841 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:04.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:04 trial078 ceph-mon[22944]: pgmap v184: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 11 KiB/s wr, 24 op/s 2026-02-13T02:42:04.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:04 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1243152066' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T02:42:04.884 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:04 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/327098182' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T02:42:04.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:04 trial091 ceph-mon[27614]: pgmap v184: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 11 KiB/s wr, 24 op/s 2026-02-13T02:42:04.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:04 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1243152066' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T02:42:04.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:04 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/327098182' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T02:42:05.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:04 trial154 ceph-mon[27921]: pgmap v184: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 11 KiB/s wr, 24 op/s 2026-02-13T02:42:05.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:04 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1243152066' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T02:42:05.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:04 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/327098182' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T02:42:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 -- 10.20.193.78:0/3162241965 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f026410f200 msgr2=0x7f026410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 --2- 10.20.193.78:0/3162241965 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f026410f200 0x7f026410f5d0 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=5830055849048571047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02580099a0 tx=0x7f025802ed00 comp rx=0 tx=0).stop 2026-02-13T02:42:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 -- 10.20.193.78:0/3162241965 shutdown_connections 2026-02-13T02:42:05.036 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 --2- 10.20.193.78:0/3162241965 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0264115410 0x7f0264175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 --2- 10.20.193.78:0/3162241965 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f026410fbf0 0x7f0264114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 --2- 10.20.193.78:0/3162241965 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f026410f200 0x7f026410f5d0 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=5830055849048571047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 -- 10.20.193.78:0/3162241965 >> 10.20.193.78:0/3162241965 conn(0x7f02640ecb00 msgr2=0x7f026410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:05.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 -- 10.20.193.78:0/3162241965 shutdown_connections 2026-02-13T02:42:05.037 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.034+0000 7f02691486c0 1 -- 10.20.193.78:0/3162241965 wait complete. 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 Processor -- start 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 -- start start 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f026410f200 0x7f026411d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0264115410 0x7f026411d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0264122ae0 0x7f0264122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f02641234f0 con 0x7f0264122ae0 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0264123660 con 0x7f0264115410 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02691486c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0264123820 con 0x7f026410f200 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02635776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0264122ae0 0x7f0264122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02635776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0264122ae0 0x7f0264122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55330/0 (socket says 10.20.193.78:55330) 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02635776c0 1 -- 10.20.193.78:0/2712568616 learned_addr learned my addr 10.20.193.78:0/2712568616 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f0262d766c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f026410f200 0x7f026411d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.035+0000 7f02625756c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0264115410 0x7f026411d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0262d766c0 1 -- 10.20.193.78:0/2712568616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0264115410 msgr2=0x7f026411d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0262d766c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0264115410 0x7f026411d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0262d766c0 1 -- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0264122ae0 msgr2=0x7f0264122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0262d766c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0264122ae0 0x7f0264122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0262d766c0 1 -- 10.20.193.78:0/2712568616 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0258009590 con 0x7f026410f200 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f02635776c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0264122ae0 0x7f0264122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0262d766c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f026410f200 0x7f026411d1e0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f025802f210 tx=0x7f025802fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:05.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0243fff6c0 1 -- 10.20.193.78:0/2712568616 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0258002ae0 con 0x7f026410f200 2026-02-13T02:42:05.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0243fff6c0 1 -- 10.20.193.78:0/2712568616 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f02580046b0 con 0x7f026410f200 2026-02-13T02:42:05.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f0243fff6c0 1 -- 10.20.193.78:0/2712568616 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02580312b0 con 0x7f026410f200 2026-02-13T02:42:05.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0264163c70 con 0x7f026410f200 2026-02-13T02:42:05.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.036+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02641640a0 con 0x7f026410f200 2026-02-13T02:42:05.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.037+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0228005310 con 0x7f026410f200 2026-02-13T02:42:05.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.039+0000 7f0243fff6c0 1 -- 10.20.193.78:0/2712568616 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0258002c40 con 0x7f026410f200 2026-02-13T02:42:05.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.040+0000 7f0243fff6c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f02380b5760 0x7f02380d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.040+0000 7f0243fff6c0 1 -- 10.20.193.78:0/2712568616 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f0258107d80 con 0x7f026410f200 2026-02-13T02:42:05.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.040+0000 7f0243fff6c0 1 -- 10.20.193.78:0/2712568616 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0258108200 con 0x7f026410f200 2026-02-13T02:42:05.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.041+0000 7f02625756c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f02380b5760 0x7f02380d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.043 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.041+0000 7f02625756c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f02380b5760 0x7f02380d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0264123b70 tx=0x7f024c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:05.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.142+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0228005890 con 0x7f026410f200 2026-02-13T02:42:05.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.143+0000 7f0243fff6c0 1 -- 10.20.193.78:0/2712568616 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22316 (secure 0 0 0) 0x7f02580ca6d0 con 0x7f026410f200 2026-02-13T02:42:05.147 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:05.148 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":75,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","created":"2026-02-13T02:38:52.551926+0000","modified":"2026-02-13T02:41:51.594154+0000","last_up_change":"2026-02-13T02:41:29.235143+0000","last_in_change":"2026-02-13T02:41:20.987708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:40:11.017308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:41:47.641058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:41:49.198912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4e99f87-c52f-4ab4-9ef0-2fc796b8084f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6803","nonce":2712462435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6805","nonce":2712462435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6809","nonce":2712462435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6807","nonce":2712462435}]},"public_addr":"10.20.193.78:6803/2712462435","cluster_addr":"10.20.193.78:6805/2712462435","heartbeat_back_addr":"10.20.193.78:6809/2712462435","heartbeat_front_addr":"10.20.193.78:6807/2712462435","state":["exists","up"]},{"osd":1,"uuid":"75b41a4c-dddc-4c29-885c-997d3f7212c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6800","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6801","nonce":196768757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6803","nonce":196768757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6807","nonce":196768757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6805","nonce":196768757}]},"public_addr":"10.20.193.91:6801/196768757","cluster_addr":"10.20.193.91:6803/196768757","heartbeat_back_addr":"10.20.193.91:6807/196768757","heartbeat_front_addr":"10.20.193.91:6805/196768757","state":["exists","up"]},{"osd":2,"uuid":"2697034a-905b-4bdb-adb4-4f945060e9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6801","nonce":2640210611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6803","nonce":2640210611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6807","nonce":2640210611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6805","nonce":2640210611}]},"public_addr":"10.20.193.154:6801/2640210611","cluster_addr":"10.20.193.154:6803/2640210611","heartbeat_back_addr":"10.20.193.154:6807/2640210611","heartbeat_front_addr":"10.20.193.154:6805/2640210611","state":["exists","up"]},{"osd":3,"uuid":"520c54bf-23d1-4eee-9bb8-a89711e96784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6811","nonce":71468509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6813","nonce":71468509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6817","nonce":71468509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6815","nonce":71468509}]},"public_addr":"10.20.193.78:6811/71468509","cluster_addr":"10.20.193.78:6813/71468509","heartbeat_back_addr":"10.20.193.78:6817/71468509","heartbeat_front_addr":"10.20.193.78:6815/71468509","state":["exists","up"]},{"osd":4,"uuid":"a4c56acb-cf6d-4fb7-a682-d848d6b2651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6809","nonce":4184387195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6811","nonce":4184387195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6815","nonce":4184387195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6813","nonce":4184387195}]},"public_addr":"10.20.193.91:6809/4184387195","cluster_addr":"10.20.193.91:6811/4184387195","heartbeat_back_addr":"10.20.193.91:6815/4184387195","heartbeat_front_addr":"10.20.193.91:6813/4184387195","state":["exists","up"]},{"osd":5,"uuid":"1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6809","nonce":1052719265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6811","nonce":1052719265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6815","nonce":1052719265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6813","nonce":1052719265}]},"public_addr":"10.20.193.154:6809/1052719265","cluster_addr":"10.20.193.154:6811/1052719265","heartbeat_back_addr":"10.20.193.154:6815/1052719265","heartbeat_front_addr":"10.20.193.154:6813/1052719265","state":["exists","up"]},{"osd":6,"uuid":"0cdd77aa-b764-4477-b092-4863371bead5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6819","nonce":1255269393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6821","nonce":1255269393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6825","nonce":1255269393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6823","nonce":1255269393}]},"public_addr":"10.20.193.78:6819/1255269393","cluster_addr":"10.20.193.78:6821/1255269393","heartbeat_back_addr":"10.20.193.78:6825/1255269393","heartbeat_front_addr":"10.20.193.78:6823/1255269393","state":["exists","up"]},{"osd":7,"uuid":"b26572df-8730-4245-996e-9f6ad280cd39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6817","nonce":3280635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6819","nonce":3280635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6823","nonce":3280635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6821","nonce":3280635476}]},"public_addr":"10.20.193.91:6817/3280635476","cluster_addr":"10.20.193.91:6819/3280635476","heartbeat_back_addr":"10.20.193.91:6823/3280635476","heartbeat_front_addr":"10.20.193.91:6821/3280635476","state":["exists","up"]},{"osd":8,"uuid":"87ca52a3-dbf2-4405-b992-876c1a7287a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6817","nonce":1767687637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6819","nonce":1767687637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6823","nonce":1767687637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6821","nonce":1767687637}]},"public_addr":"10.20.193.154:6817/1767687637","cluster_addr":"10.20.193.154:6819/1767687637","heartbeat_back_addr":"10.20.193.154:6823/1767687637","heartbeat_front_addr":"10.20.193.154:6821/1767687637","state":["exists","up"]},{"osd":9,"uuid":"771bc3b1-5e53-408b-a87c-9e9a2174df76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6827","nonce":4211100741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6829","nonce":4211100741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6833","nonce":4211100741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6831","nonce":4211100741}]},"public_addr":"10.20.193.78:6827/4211100741","cluster_addr":"10.20.193.78:6829/4211100741","heartbeat_back_addr":"10.20.193.78:6833/4211100741","heartbeat_front_addr":"10.20.193.78:6831/4211100741","state":["exists","up"]},{"osd":10,"uuid":"34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6825","nonce":1302687241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6827","nonce":1302687241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6831","nonce":1302687241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6829","nonce":1302687241}]},"public_addr":"10.20.193.91:6825/1302687241","cluster_addr":"10.20.193.91:6827/1302687241","heartbeat_back_addr":"10.20.193.91:6831/1302687241","heartbeat_front_addr":"10.20.193.91:6829/1302687241","state":["exists","up"]},{"osd":11,"uuid":"28724285-e1a8-4a0f-9b85-fc1a478ddc47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6825","nonce":1149779767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6827","nonce":1149779767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6831","nonce":1149779767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6829","nonce":1149779767}]},"public_addr":"10.20.193.154:6825/1149779767","cluster_addr":"10.20.193.154:6827/1149779767","heartbeat_back_addr":"10.20.193.154:6831/1149779767","heartbeat_front_addr":"10.20.193.154:6829/1149779767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:39:54.522850+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:02.051630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:08.940267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:20.309397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:27.909293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:35.059447+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:46.172446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:53.926260+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:01.093058+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:12.051230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:20.096746+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:27.469090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.78:6801/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6800/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/97242544":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/1589977769":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/3668729280":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/2986039701":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/1592616596":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6801/3975596185":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/2877801719":"2026-02-14T02:39:00.593239+0000","10.20.193.78:6800/3975596185":"2026-02-14T02:39:00.593239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:42:05.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.145+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f02380b5760 msgr2=0x7f02380d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.145+0000 7f02691486c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f02380b5760 0x7f02380d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0264123b70 tx=0x7f024c009260 comp rx=0 tx=0).stop 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.145+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f026410f200 msgr2=0x7f026411d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.145+0000 7f02691486c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f026410f200 0x7f026411d1e0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f025802f210 tx=0x7f025802fc60 comp rx=0 tx=0).stop 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 shutdown_connections 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f02380b5760 0x7f02380d5c10 unknown :-1 s=CLOSED pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0264122ae0 0x7f0264122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0264115410 0x7f026411d720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 --2- 10.20.193.78:0/2712568616 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f026410f200 0x7f026411d1e0 unknown :-1 s=CLOSED pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 >> 10.20.193.78:0/2712568616 conn(0x7f02640ecb00 msgr2=0x7f026410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:05.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 shutdown_connections 2026-02-13T02:42:05.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.146+0000 7f02691486c0 1 -- 10.20.193.78:0/2712568616 wait complete. 2026-02-13T02:42:05.285 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T02:42:05.285 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:42:05.468 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:05.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.657+0000 7f22c27576c0 1 -- 10.20.193.78:0/3667781077 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc115410 msgr2=0x7f22bc175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.657+0000 7f22c27576c0 1 --2- 10.20.193.78:0/3667781077 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc115410 0x7f22bc175db0 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=3411465820098484701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22b000aa70 tx=0x7f22b002fde0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.658+0000 7f22c27576c0 1 -- 10.20.193.78:0/3667781077 shutdown_connections 2026-02-13T02:42:05.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.658+0000 7f22c27576c0 1 --2- 10.20.193.78:0/3667781077 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc115410 0x7f22bc175db0 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=3411465820098484701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.658+0000 7f22c27576c0 1 --2- 10.20.193.78:0/3667781077 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22bc10fbf0 0x7f22bc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.658+0000 7f22c27576c0 1 --2- 10.20.193.78:0/3667781077 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22bc10f200 0x7f22bc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.658+0000 7f22c27576c0 1 -- 10.20.193.78:0/3667781077 >> 10.20.193.78:0/3667781077 conn(0x7f22bc0ecb00 msgr2=0x7f22bc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:05.661 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.658+0000 7f22c27576c0 1 -- 10.20.193.78:0/3667781077 shutdown_connections 2026-02-13T02:42:05.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.659+0000 7f22c27576c0 1 -- 10.20.193.78:0/3667781077 wait complete. 2026-02-13T02:42:05.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.659+0000 7f22c27576c0 1 Processor -- start 2026-02-13T02:42:05.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.659+0000 7f22c27576c0 1 -- start start 2026-02-13T02:42:05.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c27576c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22bc10f200 0x7f22bc11d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c27576c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22bc115410 0x7f22bc11d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c27576c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc122a80 0x7f22bc122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c27576c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc123490 con 0x7f22bc122a80 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c27576c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc123600 con 0x7f22bc10f200 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c27576c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1237c0 con 0x7f22bc115410 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc122a80 0x7f22bc122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc122a80 0x7f22bc122f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55350/0 (socket says 10.20.193.78:55350) 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 -- 10.20.193.78:0/4220838547 learned_addr learned my addr 10.20.193.78:0/4220838547 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22bbfff6c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22bc10f200 0x7f22bc11d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22bb7fe6c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22bc115410 0x7f22bc11d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 -- 10.20.193.78:0/4220838547 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22bc115410 msgr2=0x7f22bc11d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22bc115410 0x7f22bc11d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 -- 10.20.193.78:0/4220838547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22bc10f200 msgr2=0x7f22bc11d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22bc10f200 0x7f22bc11d180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 -- 10.20.193.78:0/4220838547 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b000a660 con 0x7f22bc122a80 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22bbfff6c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22bc10f200 0x7f22bc11d180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22c0cc96c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc122a80 0x7f22bc122f20 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22b00054b0 tx=0x7f22b00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.660+0000 7f22b97fa6c0 1 -- 10.20.193.78:0/4220838547 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22b0003a30 con 0x7f22bc122a80 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.661+0000 7f22b97fa6c0 1 -- 10.20.193.78:0/4220838547 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f22b0003b90 con 0x7f22bc122a80 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.661+0000 7f22b97fa6c0 1 -- 10.20.193.78:0/4220838547 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22b0038380 con 0x7f22bc122a80 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.661+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc163c10 con 0x7f22bc122a80 2026-02-13T02:42:05.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.661+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc164040 con 0x7f22bc122a80 2026-02-13T02:42:05.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.661+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc1104d0 con 0x7f22bc122a80 2026-02-13T02:42:05.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.663+0000 7f22b97fa6c0 1 -- 10.20.193.78:0/4220838547 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f22b0008350 con 0x7f22bc122a80 2026-02-13T02:42:05.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.665+0000 7f22b97fa6c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22900b5760 0x7f22900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:05.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.665+0000 7f22b97fa6c0 1 -- 10.20.193.78:0/4220838547 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f22b01090c0 con 0x7f22bc122a80 2026-02-13T02:42:05.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.665+0000 7f22b97fa6c0 1 -- 10.20.193.78:0/4220838547 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f22b0109540 con 0x7f22bc122a80 2026-02-13T02:42:05.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.665+0000 7f22bbfff6c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22900b5760 0x7f22900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:05.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.665+0000 7f22bbfff6c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22900b5760 0x7f22900d5c10 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22a8004750 tx=0x7f22a8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:05.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.772+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22bc11e2d0 con 0x7f22bc122a80 2026-02-13T02:42:05.774 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:05 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2712568616' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:05.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.773+0000 7f22b97fa6c0 1 -- 10.20.193.78:0/4220838547 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22316 (secure 0 0 0) 0x7f22b00cba10 con 0x7f22bc122a80 2026-02-13T02:42:05.775 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:05.776 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":75,"fsid":"1779b03c-0885-11f1-aeb9-d404e6e7d460","created":"2026-02-13T02:38:52.551926+0000","modified":"2026-02-13T02:41:51.594154+0000","last_up_change":"2026-02-13T02:41:29.235143+0000","last_in_change":"2026-02-13T02:41:20.987708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:40:11.017308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:41:47.641058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:41:49.198912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4e99f87-c52f-4ab4-9ef0-2fc796b8084f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6803","nonce":2712462435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6805","nonce":2712462435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6809","nonce":2712462435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":2712462435},{"type":"v1","addr":"10.20.193.78:6807","nonce":2712462435}]},"public_addr":"10.20.193.78:6803/2712462435","cluster_addr":"10.20.193.78:6805/2712462435","heartbeat_back_addr":"10.20.193.78:6809/2712462435","heartbeat_front_addr":"10.20.193.78:6807/2712462435","state":["exists","up"]},{"osd":1,"uuid":"75b41a4c-dddc-4c29-885c-997d3f7212c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6800","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6801","nonce":196768757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6803","nonce":196768757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6807","nonce":196768757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":196768757},{"type":"v1","addr":"10.20.193.91:6805","nonce":196768757}]},"public_addr":"10.20.193.91:6801/196768757","cluster_addr":"10.20.193.91:6803/196768757","heartbeat_back_addr":"10.20.193.91:6807/196768757","heartbeat_front_addr":"10.20.193.91:6805/196768757","state":["exists","up"]},{"osd":2,"uuid":"2697034a-905b-4bdb-adb4-4f945060e9e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6801","nonce":2640210611}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6803","nonce":2640210611}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6807","nonce":2640210611}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":2640210611},{"type":"v1","addr":"10.20.193.154:6805","nonce":2640210611}]},"public_addr":"10.20.193.154:6801/2640210611","cluster_addr":"10.20.193.154:6803/2640210611","heartbeat_back_addr":"10.20.193.154:6807/2640210611","heartbeat_front_addr":"10.20.193.154:6805/2640210611","state":["exists","up"]},{"osd":3,"uuid":"520c54bf-23d1-4eee-9bb8-a89711e96784","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6811","nonce":71468509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6813","nonce":71468509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6817","nonce":71468509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":71468509},{"type":"v1","addr":"10.20.193.78:6815","nonce":71468509}]},"public_addr":"10.20.193.78:6811/71468509","cluster_addr":"10.20.193.78:6813/71468509","heartbeat_back_addr":"10.20.193.78:6817/71468509","heartbeat_front_addr":"10.20.193.78:6815/71468509","state":["exists","up"]},{"osd":4,"uuid":"a4c56acb-cf6d-4fb7-a682-d848d6b2651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6809","nonce":4184387195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6811","nonce":4184387195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6815","nonce":4184387195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":4184387195},{"type":"v1","addr":"10.20.193.91:6813","nonce":4184387195}]},"public_addr":"10.20.193.91:6809/4184387195","cluster_addr":"10.20.193.91:6811/4184387195","heartbeat_back_addr":"10.20.193.91:6815/4184387195","heartbeat_front_addr":"10.20.193.91:6813/4184387195","state":["exists","up"]},{"osd":5,"uuid":"1d0a64ce-f8f0-41f5-8f1c-a6ec7c190b47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6809","nonce":1052719265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6811","nonce":1052719265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6815","nonce":1052719265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":1052719265},{"type":"v1","addr":"10.20.193.154:6813","nonce":1052719265}]},"public_addr":"10.20.193.154:6809/1052719265","cluster_addr":"10.20.193.154:6811/1052719265","heartbeat_back_addr":"10.20.193.154:6815/1052719265","heartbeat_front_addr":"10.20.193.154:6813/1052719265","state":["exists","up"]},{"osd":6,"uuid":"0cdd77aa-b764-4477-b092-4863371bead5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6819","nonce":1255269393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6821","nonce":1255269393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6825","nonce":1255269393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":1255269393},{"type":"v1","addr":"10.20.193.78:6823","nonce":1255269393}]},"public_addr":"10.20.193.78:6819/1255269393","cluster_addr":"10.20.193.78:6821/1255269393","heartbeat_back_addr":"10.20.193.78:6825/1255269393","heartbeat_front_addr":"10.20.193.78:6823/1255269393","state":["exists","up"]},{"osd":7,"uuid":"b26572df-8730-4245-996e-9f6ad280cd39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6817","nonce":3280635476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6819","nonce":3280635476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6823","nonce":3280635476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":3280635476},{"type":"v1","addr":"10.20.193.91:6821","nonce":3280635476}]},"public_addr":"10.20.193.91:6817/3280635476","cluster_addr":"10.20.193.91:6819/3280635476","heartbeat_back_addr":"10.20.193.91:6823/3280635476","heartbeat_front_addr":"10.20.193.91:6821/3280635476","state":["exists","up"]},{"osd":8,"uuid":"87ca52a3-dbf2-4405-b992-876c1a7287a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6817","nonce":1767687637}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6819","nonce":1767687637}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6823","nonce":1767687637}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1767687637},{"type":"v1","addr":"10.20.193.154:6821","nonce":1767687637}]},"public_addr":"10.20.193.154:6817/1767687637","cluster_addr":"10.20.193.154:6819/1767687637","heartbeat_back_addr":"10.20.193.154:6823/1767687637","heartbeat_front_addr":"10.20.193.154:6821/1767687637","state":["exists","up"]},{"osd":9,"uuid":"771bc3b1-5e53-408b-a87c-9e9a2174df76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6827","nonce":4211100741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6829","nonce":4211100741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6833","nonce":4211100741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":4211100741},{"type":"v1","addr":"10.20.193.78:6831","nonce":4211100741}]},"public_addr":"10.20.193.78:6827/4211100741","cluster_addr":"10.20.193.78:6829/4211100741","heartbeat_back_addr":"10.20.193.78:6833/4211100741","heartbeat_front_addr":"10.20.193.78:6831/4211100741","state":["exists","up"]},{"osd":10,"uuid":"34fcd1d6-41e6-45fd-aeba-67b7eb0f76cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6825","nonce":1302687241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6827","nonce":1302687241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6831","nonce":1302687241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1302687241},{"type":"v1","addr":"10.20.193.91:6829","nonce":1302687241}]},"public_addr":"10.20.193.91:6825/1302687241","cluster_addr":"10.20.193.91:6827/1302687241","heartbeat_back_addr":"10.20.193.91:6831/1302687241","heartbeat_front_addr":"10.20.193.91:6829/1302687241","state":["exists","up"]},{"osd":11,"uuid":"28724285-e1a8-4a0f-9b85-fc1a478ddc47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6825","nonce":1149779767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6827","nonce":1149779767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6831","nonce":1149779767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1149779767},{"type":"v1","addr":"10.20.193.154:6829","nonce":1149779767}]},"public_addr":"10.20.193.154:6825/1149779767","cluster_addr":"10.20.193.154:6827/1149779767","heartbeat_back_addr":"10.20.193.154:6831/1149779767","heartbeat_front_addr":"10.20.193.154:6829/1149779767","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:39:54.522850+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:02.051630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:08.940267+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:20.309397+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:27.909293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:35.059447+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:46.172446+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:40:53.926260+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:01.093058+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:12.051230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:20.096746+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:41:27.469090+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.78:6801/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6800/2357311610":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/97242544":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/1589977769":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/3668729280":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/2986039701":"2026-02-14T02:39:34.790548+0000","10.20.193.78:0/1592616596":"2026-02-14T02:39:34.790548+0000","10.20.193.78:6801/3975596185":"2026-02-14T02:39:00.593239+0000","10.20.193.78:0/2877801719":"2026-02-14T02:39:00.593239+0000","10.20.193.78:6800/3975596185":"2026-02-14T02:39:00.593239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:42:05.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.774+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22900b5760 msgr2=0x7f22900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.774+0000 7f22c27576c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22900b5760 0x7f22900d5c10 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22a8004750 tx=0x7f22a8009260 comp rx=0 tx=0).stop 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.774+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc122a80 msgr2=0x7f22bc122f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.774+0000 7f22c27576c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc122a80 0x7f22bc122f20 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22b00054b0 tx=0x7f22b00054e0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 shutdown_connections 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22900b5760 0x7f22900d5c10 unknown :-1 s=CLOSED pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22bc122a80 0x7f22bc122f20 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22bc115410 0x7f22bc11d6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 --2- 10.20.193.78:0/4220838547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22bc10f200 0x7f22bc11d180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 >> 10.20.193.78:0/4220838547 conn(0x7f22bc0ecb00 msgr2=0x7f22bc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:05.777 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 shutdown_connections 2026-02-13T02:42:05.778 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:05.775+0000 7f22c27576c0 1 -- 10.20.193.78:0/4220838547 wait complete. 2026-02-13T02:42:05.881 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T02:42:05.882 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T02:42:05.883 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T02:42:05.883 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T02:42:05.884 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T02:42:05.884 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T02:42:05.884 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T02:42:05.885 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T02:42:05.885 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T02:42:05.886 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T02:42:05.886 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T02:42:05.887 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T02:42:05.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:05 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2712568616' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:06.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:05 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2712568616' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:06.124 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.144 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.170 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.176 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.234 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.235 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.235 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.243 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.259 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.281 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.282 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.294 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:06.455 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.452+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/4071137214 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e8061090 msgr2=0x7f56e8154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.452+0000 7f56ef5a66c0 1 --2- 10.20.193.78:0/4071137214 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e8061090 0x7f56e8154f70 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=7241582416799046266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56d4009970 tx=0x7f56d402ed20 comp rx=0 tx=0).stop 2026-02-13T02:42:06.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.457+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/4071137214 shutdown_connections 2026-02-13T02:42:06.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.457+0000 7f56ef5a66c0 1 --2- 10.20.193.78:0/4071137214 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f56e81554b0 0x7f56e8175890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.457+0000 7f56ef5a66c0 1 --2- 10.20.193.78:0/4071137214 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e8061090 0x7f56e8154f70 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=7241582416799046266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.457+0000 7f56ef5a66c0 1 --2- 10.20.193.78:0/4071137214 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f56e8060780 0x7f56e8060b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.457+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/4071137214 >> 10.20.193.78:0/4071137214 conn(0x7f56e80ea6a0 msgr2=0x7f56e810aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.459+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/4071137214 shutdown_connections 2026-02-13T02:42:06.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.459+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/4071137214 wait complete. 2026-02-13T02:42:06.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.463+0000 7f56ef5a66c0 1 Processor -- start 2026-02-13T02:42:06.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.464+0000 7f56ef5a66c0 1 -- start start 2026-02-13T02:42:06.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ef5a66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f56e8060780 0x7f56e80599e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ef5a66c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f56e8061090 0x7f56e8059f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ef5a66c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e81554b0 0x7f56e805a460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ef5a66c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f56e814e6b0 con 0x7f56e8061090 2026-02-13T02:42:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ef5a66c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f56e814e820 con 0x7f56e8060780 2026-02-13T02:42:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ef5a66c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56e814e9e0 con 0x7f56e81554b0 2026-02-13T02:42:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ee5a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f56e8060780 0x7f56e80599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ee5a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f56e8060780 0x7f56e80599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60122/0 (socket says 10.20.193.78:60122) 2026-02-13T02:42:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56ee5a46c0 1 -- 10.20.193.78:0/2662487508 learned_addr learned my addr 10.20.193.78:0/2662487508 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.468+0000 7f56edda36c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f56e8061090 0x7f56e8059f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.469+0000 7f56eeda56c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e81554b0 0x7f56e805a460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.470+0000 7f56ee5a46c0 1 -- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e81554b0 msgr2=0x7f56e805a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.470+0000 7f56ee5a46c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e81554b0 0x7f56e805a460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.470+0000 7f56ee5a46c0 1 -- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f56e8061090 msgr2=0x7f56e8059f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.470+0000 7f56ee5a46c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f56e8061090 0x7f56e8059f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.470+0000 7f56ee5a46c0 1 -- 10.20.193.78:0/2662487508 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e00094c0 con 0x7f56e8060780 2026-02-13T02:42:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.470+0000 7f56edda36c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f56e8061090 0x7f56e8059f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:06.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.471+0000 7f56eeda56c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f56e81554b0 0x7f56e805a460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.471+0000 7f56ee5a46c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f56e8060780 0x7f56e80599e0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e000ba30 tx=0x7f56e000bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.472+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e0004250 con 0x7f56e8060780 2026-02-13T02:42:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.472+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f56e0009070 con 0x7f56e8060780 2026-02-13T02:42:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.472+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56e00071c0 con 0x7f56e8060780 2026-02-13T02:42:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.472+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d4009590 con 0x7f56e8060780 2026-02-13T02:42:06.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.472+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e814efc0 con 0x7f56e8060780 2026-02-13T02:42:06.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.477+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56b4000fe0 con 0x7f56e8060780 2026-02-13T02:42:06.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.483+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f56e0007390 con 0x7f56e8060780 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.482+0000 7f216f24c6c0 1 -- 10.20.193.78:0/3050703808 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168114000 msgr2=0x7f21681143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.482+0000 7f216f24c6c0 1 --2- 10.20.193.78:0/3050703808 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168114000 0x7f21681143d0 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=7634417162733817864 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21540085b0 tx=0x7f215402eda0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.482+0000 7f216f24c6c0 1 -- 10.20.193.78:0/3050703808 shutdown_connections 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.482+0000 7f216f24c6c0 1 --2- 10.20.193.78:0/3050703808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2168116b30 0x7f216817a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.482+0000 7f216f24c6c0 1 --2- 10.20.193.78:0/3050703808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21681149f0 0x7f2168116380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.482+0000 7f216f24c6c0 1 --2- 10.20.193.78:0/3050703808 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168114000 0x7f21681143d0 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=7634417162733817864 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.482+0000 7f216f24c6c0 1 -- 10.20.193.78:0/3050703808 >> 10.20.193.78:0/3050703808 conn(0x7f21680586e0 msgr2=0x7f2168058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.483+0000 7f216f24c6c0 1 -- 10.20.193.78:0/3050703808 shutdown_connections 2026-02-13T02:42:06.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.483+0000 7f216f24c6c0 1 -- 10.20.193.78:0/3050703808 wait complete. 2026-02-13T02:42:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.488+0000 7f216f24c6c0 1 Processor -- start 2026-02-13T02:42:06.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.488+0000 7f216f24c6c0 1 -- start start 2026-02-13T02:42:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7fcd233186c0 1 -- 10.20.193.78:0/682409307 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c114300 msgr2=0x7fcd1c114730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7fcd233186c0 1 --2- 10.20.193.78:0/682409307 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c114300 0x7fcd1c114730 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=2773496263984254551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd08009b00 tx=0x7fcd0802eeb0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.493 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7f216f24c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2168114000 0x7f2168121b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7f216f24c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168116b30 0x7f2168122040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7f216f24c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2168127400 0x7f21681278a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7f216f24c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2168127e10 con 0x7f2168116b30 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7f216f24c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2168127f80 con 0x7f2168114000 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.491+0000 7f216f24c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2168128140 con 0x7f2168127400 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f216cfc16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2168114000 0x7f2168121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168116b30 0x7f2168122040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168116b30 0x7f2168122040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:33922/0 (socket says 10.20.193.78:33922) 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 -- 10.20.193.78:0/1070818714 learned_addr learned my addr 10.20.193.78:0/1070818714 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 -- 10.20.193.78:0/1070818714 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2168127400 msgr2=0x7f21681278a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2168127400 0x7f21681278a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 -- 10.20.193.78:0/1070818714 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2168114000 msgr2=0x7f2168121b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2168114000 0x7f2168121b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 -- 10.20.193.78:0/1070818714 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21540081d0 con 0x7f2168116b30 2026-02-13T02:42:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.492+0000 7f2167fff6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168116b30 0x7f2168122040 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f215800da30 tx=0x7f215800df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2158004a80 con 0x7f2168116b30 2026-02-13T02:42:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2158009030 con 0x7f2168116b30 2026-02-13T02:42:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21580071c0 con 0x7f2168116b30 2026-02-13T02:42:06.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216816cb00 con 0x7f2168116b30 2026-02-13T02:42:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f216816cf90 con 0x7f2168116b30 2026-02-13T02:42:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7fcd233186c0 1 -- 10.20.193.78:0/682409307 shutdown_connections 2026-02-13T02:42:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7fcd233186c0 1 --2- 10.20.193.78:0/682409307 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1c15dfa0 0x7fcd1c17e3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7fcd233186c0 1 --2- 10.20.193.78:0/682409307 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c114300 0x7fcd1c114730 unknown :-1 s=CLOSED pgs=181 gs=3 cs=0 l=1 c_cookie=2773496263984254551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7fcd233186c0 1 --2- 10.20.193.78:0/682409307 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd1c1174d0 0x7fcd1c113dc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7fcd233186c0 1 -- 10.20.193.78:0/682409307 >> 10.20.193.78:0/682409307 conn(0x7fcd1c0586e0 msgr2=0x7fcd1c058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.493+0000 7fcd233186c0 1 -- 10.20.193.78:0/682409307 shutdown_connections 2026-02-13T02:42:06.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.494+0000 7fcd233186c0 1 -- 10.20.193.78:0/682409307 wait complete. 2026-02-13T02:42:06.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.495+0000 7f56d37fe6c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f56c80b58b0 0x7f56c80d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.496+0000 7fcd233186c0 1 Processor -- start 2026-02-13T02:42:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.496+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f56e00e3de0 con 0x7f56e8060780 2026-02-13T02:42:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.496+0000 7fcd233186c0 1 -- start start 2026-02-13T02:42:06.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd233186c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1c114300 0x7fcd1c167860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.496+0000 7f56d37fe6c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] conn(0x7f56c80dd020 0x7f56c80fd430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd233186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c1174d0 0x7fcd1c167da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd233186c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd1c15dfa0 0x7fcd1c16d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd233186c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c16d6d0 con 0x7fcd1c1174d0 2026-02-13T02:42:06.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.496+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 --> [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56c80fdae0 con 0x7f56c80dd020 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd233186c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c16d840 con 0x7fcd1c114300 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd233186c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c16da00 con 0x7fcd1c15dfa0 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd2108d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1c114300 0x7fcd1c167860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd2088c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c1174d0 0x7fcd1c167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd2088c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c1174d0 0x7fcd1c167da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:33930/0 (socket says 10.20.193.78:33930) 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd2088c6c0 1 -- 10.20.193.78:0/3808376934 learned_addr learned my addr 10.20.193.78:0/3808376934 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.497+0000 7fcd2188e6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd1c15dfa0 0x7fcd1c16d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.498+0000 7fcd2088c6c0 1 -- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd1c15dfa0 msgr2=0x7fcd1c16d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.494+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2168052a50 con 0x7f2168116b30 2026-02-13T02:42:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.498+0000 7fcd2088c6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd1c15dfa0 0x7fcd1c16d110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.498+0000 7fcd2088c6c0 1 -- 10.20.193.78:0/3808376934 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1c114300 msgr2=0x7fcd1c167860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.498+0000 7fcd2088c6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1c114300 0x7fcd1c167860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.498+0000 7fcd2088c6c0 1 -- 10.20.193.78:0/3808376934 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd080094c0 con 0x7fcd1c1174d0 2026-02-13T02:42:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.498+0000 7fcd2108d6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1c114300 0x7fcd1c167860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:42:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.498+0000 7fcd2188e6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd1c15dfa0 0x7fcd1c16d110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.496+0000 7f56edda36c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f56c80b58b0 0x7f56c80d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f56e00e63a0 con 0x7f56e8060780 2026-02-13T02:42:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7f56eeda56c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] conn(0x7f56c80dd020 0x7f56c80fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7fcd2088c6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c1174d0 0x7fcd1c167da0 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd08009c30 tx=0x7fcd080043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd0802f930 con 0x7fcd1c1174d0 2026-02-13T02:42:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c16dc80 con 0x7fcd1c1174d0 2026-02-13T02:42:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c15bf80 con 0x7fcd1c1174d0 2026-02-13T02:42:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd08007490 con 0x7fcd1c1174d0 2026-02-13T02:42:06.505 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.499+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd0802f930 con 0x7fcd1c1174d0 2026-02-13T02:42:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.500+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd1c052a50 con 0x7fcd1c1174d0 2026-02-13T02:42:06.506 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.500+0000 7f56eeda56c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] conn(0x7f56c80dd020 0x7f56c80fd430 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.510+0000 7f56edda36c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f56c80b58b0 0x7f56c80d5d60 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56d402f970 tx=0x7f56d40023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.512 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.510+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== osd.2 v2:10.20.193.154:6800/2640210611 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f56c80fdae0 con 0x7f56c80dd020 2026-02-13T02:42:06.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.513+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fcd08007af0 con 0x7fcd1c1174d0 2026-02-13T02:42:06.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.516+0000 7fcd0e7fc6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fccf80b57e0 0x7fccf80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.518 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.516+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fcd08107aa0 con 0x7fcd1c1174d0 2026-02-13T02:42:06.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7fcd0e7fc6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] conn(0x7fccf80dcf50 0x7fccf80fd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 --> [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccf80fda10 con 0x7fccf80dcf50 2026-02-13T02:42:06.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7fcd2108d6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fccf80b57e0 0x7fccf80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fcd08107e50 con 0x7fcd1c1174d0 2026-02-13T02:42:06.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7fcd2108d6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fccf80b57e0 0x7fccf80d5c90 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd18006f60 tx=0x7fcd18006ba0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.506+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2158004050 con 0x7f2168116b30 2026-02-13T02:42:06.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7f2165ffb6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f213c0b5830 0x7f213c0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f21580e3c50 con 0x7f2168116b30 2026-02-13T02:42:06.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7f216cfc16c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f213c0b5830 0x7f213c0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.521 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.517+0000 7f2165ffb6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] conn(0x7f213c0dcfa0 0x7f213c0fd3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.518+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 --> [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f213c0fda60 con 0x7f213c0dcfa0 2026-02-13T02:42:06.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.518+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f21580e4070 con 0x7f2168116b30 2026-02-13T02:42:06.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.518+0000 7f216d7c26c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] conn(0x7f213c0dcfa0 0x7f213c0fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.518+0000 7f216cfc16c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f213c0b5830 0x7f213c0d5ce0 secure :-1 s=READY pgs=159 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2154008500 tx=0x7f21540023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.520+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/1249787861 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4b80 msgr2=0x7f8efc0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.520+0000 7f8f03fff6c0 1 --2- 10.20.193.78:0/1249787861 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4b80 0x7f8efc0c9bc0 secure :-1 s=READY pgs=184 gs=2 cs=0 l=1 c_cookie=887499975448697002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8eec0098d0 tx=0x7f8eec02ec70 comp rx=0 tx=0).stop 2026-02-13T02:42:06.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/1249787861 shutdown_connections 2026-02-13T02:42:06.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7f8f03fff6c0 1 --2- 10.20.193.78:0/1249787861 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8efc0ca3a0 0x7f8efc12ad40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7f8f03fff6c0 1 --2- 10.20.193.78:0/1249787861 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4b80 0x7f8efc0c9bc0 unknown :-1 s=CLOSED pgs=184 gs=2 cs=0 l=1 c_cookie=887499975448697002 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7f8f03fff6c0 1 --2- 10.20.193.78:0/1249787861 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8efc0c4190 0x7f8efc0c4560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/1249787861 >> 10.20.193.78:0/1249787861 conn(0x7f8efc01c5c0 msgr2=0x7f8efc01cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7fcd2188e6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] conn(0x7fccf80dcf50 0x7fccf80fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/1249787861 shutdown_connections 2026-02-13T02:42:06.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.524+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/1249787861 wait complete. 2026-02-13T02:42:06.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.525+0000 7f216d7c26c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] conn(0x7f213c0dcfa0 0x7f213c0fd3b0 crc :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== osd.4 v2:10.20.193.91:6808/4184387195 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f213c0fda60 con 0x7f213c0dcfa0 2026-02-13T02:42:06.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.525+0000 7f8f03fff6c0 1 Processor -- start 2026-02-13T02:42:06.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.525+0000 7f8f03fff6c0 1 -- start start 2026-02-13T02:42:06.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7f8f03fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4190 0x7f8efc0cc6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7f8f03fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8efc0ca3a0 0x7f8efc0ccc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7f8f03fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8efc0d1ff0 0x7f8efc0d2490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.525+0000 7fcd2188e6c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] conn(0x7fccf80dcf50 0x7fccf80fd360 crc :-1 s=READY pgs=17 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== osd.8 v2:10.20.193.154:6816/1767687637 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fccf80fda10 con 0x7fccf80dcf50 2026-02-13T02:42:06.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7f8f03fff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0d2a00 con 0x7f8efc0c4190 2026-02-13T02:42:06.531 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7f8f03fff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0d2b70 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.526+0000 7f8f03fff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8efc0d2d30 con 0x7f8efc0d1ff0 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.527+0000 7f8f027fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8efc0ca3a0 0x7f8efc0ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.527+0000 7f8f037fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8efc0d1ff0 0x7f8efc0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.527+0000 7f8f037fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8efc0d1ff0 0x7f8efc0d2490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45380/0 (socket says 10.20.193.78:45380) 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.527+0000 7f8f037fe6c0 1 -- 10.20.193.78:0/3882375337 learned_addr learned my addr 10.20.193.78:0/3882375337 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.527+0000 7f8f02ffd6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4190 0x7f8efc0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.528+0000 7f8f027fc6c0 1 -- 10.20.193.78:0/3882375337 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8efc0d1ff0 msgr2=0x7f8efc0d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.528+0000 7f8f027fc6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8efc0d1ff0 0x7f8efc0d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.528+0000 7f8f027fc6c0 1 -- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4190 msgr2=0x7f8efc0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.528+0000 7f8f027fc6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4190 0x7f8efc0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.532 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.528+0000 7f8f027fc6c0 1 -- 10.20.193.78:0/3882375337 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eec0094c0 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.528+0000 7f8f02ffd6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8efc0c4190 0x7f8efc0cc6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:06.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.529+0000 7f8f027fc6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8efc0ca3a0 0x7f8efc0ccc30 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8eec02f180 tx=0x7f8eec02fbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.529+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8eec005250 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.529+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8eec002da0 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.529+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8eec0071c0 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.529+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8efc113180 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.533 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.523+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 --> [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56b4002d20 con 0x7f56c80dd020 2026-02-13T02:42:06.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.530+0000 7f56d37fe6c0 1 -- 10.20.193.78:0/2662487508 <== osd.2 v2:10.20.193.154:6800/2640210611 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f56b4002d20 con 0x7f56c80dd020 2026-02-13T02:42:06.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.531+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8efc113630 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.534 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.532+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8efc000e30 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.533+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] conn(0x7f56c80dd020 msgr2=0x7f56c80fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.533+0000 7f56ef5a66c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.154:6800/2640210611,v1:10.20.193.154:6801/2640210611] conn(0x7f56c80dd020 0x7f56c80fd430 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.533+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f56c80b58b0 msgr2=0x7f56c80d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.533+0000 7f56ef5a66c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f56c80b58b0 0x7f56c80d5d60 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56d402f970 tx=0x7f56d40023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.533+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f56e8060780 msgr2=0x7f56e80599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.533+0000 7f56ef5a66c0 1 --2- 10.20.193.78:0/2662487508 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f56e8060780 0x7f56e80599e0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56e000ba30 tx=0x7f56e000bf00 comp rx=0 tx=0).stop 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.535+0000 7f56eeda56c0 1 -- 10.20.193.78:0/2662487508 reap_dead start 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.535+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 shutdown_connections 2026-02-13T02:42:06.537 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.535+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 >> 10.20.193.78:0/2662487508 conn(0x7f56e80ea6a0 msgr2=0x7f56e810aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.535+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 shutdown_connections 2026-02-13T02:42:06.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.534+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8eec0053b0 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.535+0000 7f8ee3fff6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8ed80b57e0 0x7f8ed80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.538 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.535+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8eec107d50 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.539 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.535+0000 7f56ef5a66c0 1 -- 10.20.193.78:0/2662487508 wait complete. 2026-02-13T02:42:06.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.536+0000 7f8f02ffd6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8ed80b57e0 0x7f8ed80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.537+0000 7f8f02ffd6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8ed80b57e0 0x7f8ed80d5c90 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ef8005fd0 tx=0x7f8ef80093f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.537+0000 7f8ee3fff6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] conn(0x7f8ed80dcf50 0x7f8ed80fd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.537+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 --> [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ed80fda10 con 0x7f8ed80dcf50 2026-02-13T02:42:06.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.537+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f8eec0ca6a0 con 0x7f8efc0ca3a0 2026-02-13T02:42:06.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.537+0000 7f8f037fe6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] conn(0x7f8ed80dcf50 0x7f8ed80fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.540 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.538+0000 7f8f037fe6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] conn(0x7f8ed80dcf50 0x7f8ed80fd360 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.541 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.539+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== osd.7 v2:10.20.193.91:6816/3280635476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f8ed80fda10 con 0x7f8ed80dcf50 2026-02-13T02:42:06.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.543+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 --> [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcd1c04cc70 con 0x7fccf80dcf50 2026-02-13T02:42:06.545 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7fcd0e7fc6c0 1 -- 10.20.193.78:0/3808376934 <== osd.8 v2:10.20.193.154:6816/1767687637 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcd1c04cc70 con 0x7fccf80dcf50 2026-02-13T02:42:06.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] conn(0x7fccf80dcf50 msgr2=0x7fccf80fd360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.546 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7fcd233186c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.154:6816/1767687637,v1:10.20.193.154:6817/1767687637] conn(0x7fccf80dcf50 0x7fccf80fd360 crc :-1 s=READY pgs=17 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7f3577fff6c0 1 -- 10.20.193.78:0/1590230835 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 msgr2=0x7f35781143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/1590230835 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 0x7f35781143d0 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=14222149564660289011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f356c009fd0 tx=0x7f356c02f820 comp rx=0 tx=0).stop 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7f3577fff6c0 1 -- 10.20.193.78:0/1590230835 shutdown_connections 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/1590230835 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3578116990 0x7f357817a5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/1590230835 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35781149f0 0x7f35781161e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/1590230835 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 0x7f35781143d0 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=14222149564660289011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.544+0000 7f3577fff6c0 1 -- 10.20.193.78:0/1590230835 >> 10.20.193.78:0/1590230835 conn(0x7f357805aaa0 msgr2=0x7f357805b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.545+0000 7f3577fff6c0 1 -- 10.20.193.78:0/1590230835 shutdown_connections 2026-02-13T02:42:06.547 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.545+0000 7f3577fff6c0 1 -- 10.20.193.78:0/1590230835 wait complete. 2026-02-13T02:42:06.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.546+0000 7f3577fff6c0 1 Processor -- start 2026-02-13T02:42:06.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.546+0000 7f3577fff6c0 1 -- start start 2026-02-13T02:42:06.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.546+0000 7f3577fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 0x7f3578185de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.548 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.546+0000 7f3577fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3578116990 0x7f3578186320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f3576ffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 0x7f3578185de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f35767fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3578116990 0x7f3578186320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f35767fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3578116990 0x7f3578186320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45402/0 (socket says 10.20.193.78:45402) 2026-02-13T02:42:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f35767fc6c0 1 -- 10.20.193.78:0/2384934981 learned_addr learned my addr 10.20.193.78:0/2384934981 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f357815a500 0x7f3578223920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3578186af0 con 0x7f3578114000 2026-02-13T02:42:06.550 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3578223e60 con 0x7f357815a500 2026-02-13T02:42:06.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.547+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3578224020 con 0x7f3578116990 2026-02-13T02:42:06.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.548+0000 7f35777fe6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f357815a500 0x7f3578223920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.548+0000 7f35767fc6c0 1 -- 10.20.193.78:0/2384934981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f357815a500 msgr2=0x7f3578223920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.548+0000 7f35767fc6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f357815a500 0x7f3578223920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.548+0000 7f35767fc6c0 1 -- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 msgr2=0x7f3578185de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.548+0000 7f35767fc6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 0x7f3578185de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.551 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.548+0000 7f35767fc6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c009e40 con 0x7f3578116990 2026-02-13T02:42:06.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.548+0000 7f3576ffd6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578114000 0x7f3578185de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:42:06.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fccf80b57e0 msgr2=0x7fccf80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7f35767fc6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3578116990 0x7f3578186320 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f356000b780 tx=0x7f356000bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3560004a80 con 0x7f3578116990 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3578224300 con 0x7f3578116990 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3560009030 con 0x7f3578116990 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3560004a80 con 0x7f3578116990 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.550+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3578224830 con 0x7f3578116990 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fccf80b57e0 0x7fccf80d5c90 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd18006f60 tx=0x7fcd18006ba0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c1174d0 msgr2=0x7fcd1c167da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 --2- 10.20.193.78:0/3808376934 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd1c1174d0 0x7fcd1c167da0 secure :-1 s=READY pgs=183 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd08009c30 tx=0x7fcd080043f0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd2188e6c0 1 -- 10.20.193.78:0/3808376934 reap_dead start 2026-02-13T02:42:06.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 shutdown_connections 2026-02-13T02:42:06.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 >> 10.20.193.78:0/3808376934 conn(0x7fcd1c0586e0 msgr2=0x7fcd1c15e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 shutdown_connections 2026-02-13T02:42:06.554 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.549+0000 7fcd233186c0 1 -- 10.20.193.78:0/3808376934 wait complete. 2026-02-13T02:42:06.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.552+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f356000cb20 con 0x7f3578116990 2026-02-13T02:42:06.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.554+0000 7f3557fff6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f354c0b5840 0x7f354c0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.554+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f35600e3740 con 0x7f3578116990 2026-02-13T02:42:06.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.554+0000 7f3576ffd6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f354c0b5840 0x7f354c0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.555+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f353c000fe0 con 0x7f3578116990 2026-02-13T02:42:06.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.555+0000 7f3557fff6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] conn(0x7f354c0dcfb0 0x7f354c0fd3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.555+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f354c0fda70 con 0x7f354c0dcfb0 2026-02-13T02:42:06.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.555+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f35600a6090 con 0x7f3578116990 2026-02-13T02:42:06.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.555+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 --> [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f216817d9c0 con 0x7f213c0dcfa0 2026-02-13T02:42:06.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.556+0000 7f3576ffd6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f354c0b5840 0x7f354c0d5cf0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f356c00b450 tx=0x7f356c005c40 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.556+0000 7f35777fe6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] conn(0x7f354c0dcfb0 0x7f354c0fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.556+0000 7f35777fe6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] conn(0x7f354c0dcfb0 0x7f354c0fd3c0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.556+0000 7f2165ffb6c0 1 -- 10.20.193.78:0/1070818714 <== osd.4 v2:10.20.193.91:6808/4184387195 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f216817d9c0 con 0x7f213c0dcfa0 2026-02-13T02:42:06.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.557+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== osd.0 v2:10.20.193.78:6802/2712462435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f354c0fda70 con 0x7f354c0dcfb0 2026-02-13T02:42:06.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.557+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 >> [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] conn(0x7f213c0dcfa0 msgr2=0x7f213c0fd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.557+0000 7f216f24c6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.91:6808/4184387195,v1:10.20.193.91:6809/4184387195] conn(0x7f213c0dcfa0 0x7f213c0fd3b0 crc :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.558+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f213c0b5830 msgr2=0x7f213c0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.558+0000 7f216f24c6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f213c0b5830 0x7f213c0d5ce0 secure :-1 s=READY pgs=159 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2154008500 tx=0x7f21540023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.558+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168116b30 msgr2=0x7f2168122040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.558+0000 7f216f24c6c0 1 --2- 10.20.193.78:0/1070818714 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2168116b30 0x7f2168122040 secure :-1 s=READY pgs=182 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f215800da30 tx=0x7f215800df00 comp rx=0 tx=0).stop 2026-02-13T02:42:06.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.558+0000 7f216d7c26c0 1 -- 10.20.193.78:0/1070818714 reap_dead start 2026-02-13T02:42:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.570+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 shutdown_connections 2026-02-13T02:42:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.570+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 >> 10.20.193.78:0/1070818714 conn(0x7f21680586e0 msgr2=0x7f2168117360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.570+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 shutdown_connections 2026-02-13T02:42:06.573 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.570+0000 7f216f24c6c0 1 -- 10.20.193.78:0/1070818714 wait complete. 2026-02-13T02:42:06.574 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.571+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 --> [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f353c002d20 con 0x7f354c0dcfb0 2026-02-13T02:42:06.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.573+0000 7f3557fff6c0 1 -- 10.20.193.78:0/2384934981 <== osd.0 v2:10.20.193.78:6802/2712462435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f353c002d20 con 0x7f354c0dcfb0 2026-02-13T02:42:06.575 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.573+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] conn(0x7f354c0dcfb0 msgr2=0x7f354c0fd3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.574+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6802/2712462435,v1:10.20.193.78:6803/2712462435] conn(0x7f354c0dcfb0 0x7f354c0fd3c0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.574+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f354c0b5840 msgr2=0x7f354c0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.575+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f354c0b5840 0x7f354c0d5cf0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f356c00b450 tx=0x7f356c005c40 comp rx=0 tx=0).stop 2026-02-13T02:42:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.577+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3578116990 msgr2=0x7f3578186320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.577+0000 7f3577fff6c0 1 --2- 10.20.193.78:0/2384934981 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3578116990 0x7f3578186320 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f356000b780 tx=0x7f356000bc50 comp rx=0 tx=0).stop 2026-02-13T02:42:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.577+0000 7f35777fe6c0 1 -- 10.20.193.78:0/2384934981 reap_dead start 2026-02-13T02:42:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.578+0000 7f555bfa76c0 1 -- 10.20.193.78:0/2835950900 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554114000 msgr2=0x7f55541143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.578+0000 7f555bfa76c0 1 --2- 10.20.193.78:0/2835950900 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554114000 0x7f55541143d0 secure :-1 s=READY pgs=186 gs=3 cs=0 l=1 c_cookie=1020923774871669554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5550009b00 tx=0x7f555002eef0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.583+0000 7f555bfa76c0 1 -- 10.20.193.78:0/2835950900 shutdown_connections 2026-02-13T02:42:06.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.584+0000 7f555bfa76c0 1 --2- 10.20.193.78:0/2835950900 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5554116990 0x7f555417a5a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.584+0000 7f555bfa76c0 1 --2- 10.20.193.78:0/2835950900 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55541149f0 0x7f55541161e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.584+0000 7f555bfa76c0 1 --2- 10.20.193.78:0/2835950900 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554114000 0x7f55541143d0 unknown :-1 s=CLOSED pgs=186 gs=3 cs=0 l=1 c_cookie=1020923774871669554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.584+0000 7f555bfa76c0 1 -- 10.20.193.78:0/2835950900 >> 10.20.193.78:0/2835950900 conn(0x7f555405aaa0 msgr2=0x7f555405b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.584+0000 7f555bfa76c0 1 -- 10.20.193.78:0/2835950900 shutdown_connections 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.584+0000 7f555bfa76c0 1 -- 10.20.193.78:0/2835950900 wait complete. 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.585+0000 7f555bfa76c0 1 Processor -- start 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.585+0000 7f555bfa76c0 1 -- start start 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.585+0000 7f555bfa76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5554114000 0x7f555411cad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.585+0000 7f555bfa76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554116990 0x7f555411d010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.585+0000 7f555bfa76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55541223d0 0x7f5554122870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f5559d186c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5554114000 0x7f555411cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f555bfa76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5554122de0 con 0x7f5554116990 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f5559d186c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5554114000 0x7f555411cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45416/0 (socket says 10.20.193.78:45416) 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f5559d186c0 1 -- 10.20.193.78:0/503707758 learned_addr learned my addr 10.20.193.78:0/503707758 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f555a5196c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55541223d0 0x7f5554122870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f55595176c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554116990 0x7f555411d010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5554122f50 con 0x7f55541223d0 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.586+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5554123110 con 0x7f5554114000 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.587+0000 7f5559d186c0 1 -- 10.20.193.78:0/503707758 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55541223d0 msgr2=0x7f5554122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.587+0000 7f5559d186c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55541223d0 0x7f5554122870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.587+0000 7f5559d186c0 1 -- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554116990 msgr2=0x7f555411d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.587+0000 7f5559d186c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554116990 0x7f555411d010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.587+0000 7f5559d186c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55500094c0 con 0x7f5554114000 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.587+0000 7f55595176c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5554116990 0x7f555411d010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.587+0000 7f5559d186c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5554114000 0x7f555411cad0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55500023e0 tx=0x7f5550004220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.588+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5550005250 con 0x7f5554114000 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.588+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f555002fc30 con 0x7f5554114000 2026-02-13T02:42:06.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.588+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5550007260 con 0x7f5554114000 2026-02-13T02:42:06.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.588+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5554163560 con 0x7f5554114000 2026-02-13T02:42:06.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.588+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5554163990 con 0x7f5554114000 2026-02-13T02:42:06.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.588+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5554052a50 con 0x7f5554114000 2026-02-13T02:42:06.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.591+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 --> [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8efc12e0c0 con 0x7f8ed80dcf50 2026-02-13T02:42:06.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.591+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f555002f750 con 0x7f5554114000 2026-02-13T02:42:06.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.592+0000 7f5542ffd6c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f55300b58b0 0x7f55300d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.592+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f5550107d40 con 0x7f5554114000 2026-02-13T02:42:06.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.592+0000 7f55595176c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f55300b58b0 0x7f55300d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.592+0000 7f5542ffd6c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] conn(0x7f55300dd020 0x7f55300fd430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.593+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55300fdae0 con 0x7f55300dd020 2026-02-13T02:42:06.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.593+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f5550108070 con 0x7f5554114000 2026-02-13T02:42:06.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.593+0000 7f555a5196c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] conn(0x7f55300dd020 0x7f55300fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.593+0000 7f555a5196c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] conn(0x7f55300dd020 0x7f55300fd430 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.594+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 shutdown_connections 2026-02-13T02:42:06.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.594+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 >> 10.20.193.78:0/2384934981 conn(0x7f357805aaa0 msgr2=0x7f35781179b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.594+0000 7f8ee3fff6c0 1 -- 10.20.193.78:0/3882375337 <== osd.7 v2:10.20.193.91:6816/3280635476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8efc12e0c0 con 0x7f8ed80dcf50 2026-02-13T02:42:06.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.596+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 shutdown_connections 2026-02-13T02:42:06.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.597+0000 7f3577fff6c0 1 -- 10.20.193.78:0/2384934981 wait complete. 2026-02-13T02:42:06.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.597+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] conn(0x7f8ed80dcf50 msgr2=0x7f8ed80fd360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.597+0000 7f8f03fff6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:6816/3280635476,v1:10.20.193.91:6817/3280635476] conn(0x7f8ed80dcf50 0x7f8ed80fd360 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.598+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8ed80b57e0 msgr2=0x7f8ed80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.598+0000 7f8f03fff6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8ed80b57e0 0x7f8ed80d5c90 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ef8005fd0 tx=0x7f8ef80093f0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.598+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8efc0ca3a0 msgr2=0x7f8efc0ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.598+0000 7f8f03fff6c0 1 --2- 10.20.193.78:0/3882375337 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8efc0ca3a0 0x7f8efc0ccc30 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8eec02f180 tx=0x7f8eec02fbd0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.596+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== osd.9 v2:10.20.193.78:6826/4211100741 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f55300fdae0 con 0x7f55300dd020 2026-02-13T02:42:06.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.600+0000 7f55595176c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f55300b58b0 0x7f55300d5d60 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554123460 tx=0x7f5548009190 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.603+0000 7f8f037fe6c0 1 -- 10.20.193.78:0/3882375337 reap_dead start 2026-02-13T02:42:06.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.603+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 shutdown_connections 2026-02-13T02:42:06.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.603+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 >> 10.20.193.78:0/3882375337 conn(0x7f8efc01c5c0 msgr2=0x7f8efc0c8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.603+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 shutdown_connections 2026-02-13T02:42:06.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.603+0000 7f8f03fff6c0 1 -- 10.20.193.78:0/3882375337 wait complete. 2026-02-13T02:42:06.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.610+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 --> [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5554114c40 con 0x7f55300dd020 2026-02-13T02:42:06.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.613+0000 7f5542ffd6c0 1 -- 10.20.193.78:0/503707758 <== osd.9 v2:10.20.193.78:6826/4211100741 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5554114c40 con 0x7f55300dd020 2026-02-13T02:42:06.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.613+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] conn(0x7f55300dd020 msgr2=0x7f55300fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.613+0000 7f555bfa76c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6826/4211100741,v1:10.20.193.78:6827/4211100741] conn(0x7f55300dd020 0x7f55300fd430 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f55300b58b0 msgr2=0x7f55300d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f55300b58b0 0x7f55300d5d60 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5554123460 tx=0x7f5548009190 comp rx=0 tx=0).stop 2026-02-13T02:42:06.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5554114000 msgr2=0x7f555411cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 --2- 10.20.193.78:0/503707758 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5554114000 0x7f555411cad0 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55500023e0 tx=0x7f5550004220 comp rx=0 tx=0).stop 2026-02-13T02:42:06.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555a5196c0 1 -- 10.20.193.78:0/503707758 reap_dead start 2026-02-13T02:42:06.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 shutdown_connections 2026-02-13T02:42:06.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 >> 10.20.193.78:0/503707758 conn(0x7f555405aaa0 msgr2=0x7f555405d410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 shutdown_connections 2026-02-13T02:42:06.621 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.614+0000 7f555bfa76c0 1 -- 10.20.193.78:0/503707758 wait complete. 2026-02-13T02:42:06.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.638+0000 7f9fa95746c0 1 -- 10.20.193.78:0/1175526678 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4114000 msgr2=0x7f9fa41143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.639+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/1175526678 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4114000 0x7f9fa41143d0 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=8838764264223564547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f9c00aa40 tx=0x7f9f9c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.640+0000 7f9fa95746c0 1 -- 10.20.193.78:0/1175526678 shutdown_connections 2026-02-13T02:42:06.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.640+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/1175526678 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fa4116720 0x7f9fa4116bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.640+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/1175526678 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fa4114910 0x7f9fa41161e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.640+0000 7f5de3d086c0 1 -- 10.20.193.78:0/2278994942 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 msgr2=0x7f5ddc1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.640+0000 7f5de3d086c0 1 --2- 10.20.193.78:0/2278994942 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 0x7f5ddc1143d0 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=6878375368805842608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dcc00a6c0 tx=0x7f5dcc030f50 comp rx=0 tx=0).stop 2026-02-13T02:42:06.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.640+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/1175526678 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4114000 0x7f9fa41143d0 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=8838764264223564547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.645 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f9fa95746c0 1 -- 10.20.193.78:0/1175526678 >> 10.20.193.78:0/1175526678 conn(0x7f9fa405aaa0 msgr2=0x7f9fa405b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f9fa95746c0 1 -- 10.20.193.78:0/1175526678 shutdown_connections 2026-02-13T02:42:06.646 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f9fa95746c0 1 -- 10.20.193.78:0/1175526678 wait complete. 2026-02-13T02:42:06.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f5de3d086c0 1 -- 10.20.193.78:0/2278994942 shutdown_connections 2026-02-13T02:42:06.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f5de3d086c0 1 --2- 10.20.193.78:0/2278994942 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ddc116990 0x7f5ddc17a5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f5de3d086c0 1 --2- 10.20.193.78:0/2278994942 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5ddc1149f0 0x7f5ddc1161e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f5de3d086c0 1 --2- 10.20.193.78:0/2278994942 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 0x7f5ddc1143d0 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=6878375368805842608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f5de3d086c0 1 -- 10.20.193.78:0/2278994942 >> 10.20.193.78:0/2278994942 conn(0x7f5ddc05aaa0 msgr2=0x7f5ddc05b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.644+0000 7f5de3d086c0 1 -- 10.20.193.78:0/2278994942 shutdown_connections 2026-02-13T02:42:06.647 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.645+0000 7f5de3d086c0 1 -- 10.20.193.78:0/2278994942 wait complete. 2026-02-13T02:42:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.646+0000 7f9fa95746c0 1 Processor -- start 2026-02-13T02:42:06.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.647+0000 7f5de3d086c0 1 Processor -- start 2026-02-13T02:42:06.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.647+0000 7f5de3d086c0 1 -- start start 2026-02-13T02:42:06.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.648+0000 7f5de3d086c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 0x7f5ddc1218f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.647+0000 7f9fa95746c0 1 -- start start 2026-02-13T02:42:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.648+0000 7f5de3d086c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5ddc116990 0x7f5ddc121e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.648+0000 7f5de3d086c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ddc1271f0 0x7f5ddc127690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.648+0000 7f9fa95746c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fa4114000 0x7f9fa40fcd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.649+0000 7f5de3d086c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc127bd0 con 0x7f5ddc116990 2026-02-13T02:42:06.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.649+0000 7f5de3d086c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc127d40 con 0x7f5ddc1271f0 2026-02-13T02:42:06.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.649+0000 7f9fa95746c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fa4114910 0x7f9fa40fd280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.649+0000 7f5de3d086c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc127eb0 con 0x7f5ddc114000 2026-02-13T02:42:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f5de1a796c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 0x7f5ddc1218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f5de1a796c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 0x7f5ddc1218f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45454/0 (socket says 10.20.193.78:45454) 2026-02-13T02:42:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f5de1a796c0 1 -- 10.20.193.78:0/1878420798 learned_addr learned my addr 10.20.193.78:0/1878420798 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f5de227a6c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ddc1271f0 0x7f5ddc127690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.651+0000 7f5de1a796c0 1 -- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ddc1271f0 msgr2=0x7f5ddc127690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f9fa95746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4116720 0x7f9fa4102640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.651+0000 7f5de1a796c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ddc1271f0 0x7f5ddc127690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.651+0000 7f5de1a796c0 1 -- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5ddc116990 msgr2=0x7f5ddc121e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.651+0000 7f5de12786c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5ddc116990 0x7f5ddc121e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.652+0000 7f5de1a796c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5ddc116990 0x7f5ddc121e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f9fa95746c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4102bb0 con 0x7f9fa4114910 2026-02-13T02:42:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f9fa95746c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4102d20 con 0x7f9fa4116720 2026-02-13T02:42:06.655 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.650+0000 7f9fa95746c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4102ee0 con 0x7f9fa4114000 2026-02-13T02:42:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.652+0000 7f5de1a796c0 1 -- 10.20.193.78:0/1878420798 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc00a2e0 con 0x7f5ddc114000 2026-02-13T02:42:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.651+0000 7f9fa3fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fa4114000 0x7f9fa40fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.656 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.652+0000 7f5de12786c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5ddc116990 0x7f5ddc121e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:06.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.651+0000 7f9fa3fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fa4114000 0x7f9fa40fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45456/0 (socket says 10.20.193.78:45456) 2026-02-13T02:42:06.657 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.651+0000 7f9fa3fff6c0 1 -- 10.20.193.78:0/3700101144 learned_addr learned my addr 10.20.193.78:0/3700101144 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.653+0000 7f5de1a796c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 0x7f5ddc1218f0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dcc031460 tx=0x7f5dcc0054b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.653+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5dcc003a30 con 0x7f5ddc114000 2026-02-13T02:42:06.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.653+0000 7f5de3d086c0 1 -- 10.20.193.78:0/1878420798 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc168380 con 0x7f5ddc114000 2026-02-13T02:42:06.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.654+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5dcc008b90 con 0x7f5ddc114000 2026-02-13T02:42:06.658 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.653+0000 7f9fa3fff6c0 1 -- 10.20.193.78:0/3700101144 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4116720 msgr2=0x7f9fa4102640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.654+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5dcc003a30 con 0x7f5ddc114000 2026-02-13T02:42:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.653+0000 7f9fa37fe6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fa4114910 0x7f9fa40fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.654+0000 7f5de3d086c0 1 -- 10.20.193.78:0/1878420798 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc168850 con 0x7f5ddc114000 2026-02-13T02:42:06.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.653+0000 7f9fa8d736c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4116720 0x7f9fa4102640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.660 INFO:teuthology.orchestra.run.trial078.stdout:64424509464 2026-02-13T02:42:06.661 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T02:42:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.654+0000 7f9fa3fff6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4116720 0x7f9fa4102640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.654+0000 7f9fa3fff6c0 1 -- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fa4114910 msgr2=0x7f9fa40fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.654+0000 7f9fa3fff6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fa4114910 0x7f9fa40fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.654+0000 7f9fa3fff6c0 1 -- 10.20.193.78:0/3700101144 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9c00a660 con 0x7f9fa4114000 2026-02-13T02:42:06.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.656+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ddc052a50 con 0x7f5ddc114000 2026-02-13T02:42:06.663 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.655+0000 7f9fa37fe6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fa4114910 0x7f9fa40fd280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:06.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.658+0000 7f9fa8d736c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fa4116720 0x7f9fa4102640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:06.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.660+0000 7f9fa3fff6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fa4114000 0x7f9fa40fcd40 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f9c0024b0 tx=0x7f9f9c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.660+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f5dcc003b90 con 0x7f5ddc114000 2026-02-13T02:42:06.664 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.662+0000 7f5dd2ffd6c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5dc00b59a0 0x7f5dc00d5e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.662+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f5dcc108e70 con 0x7f5ddc114000 2026-02-13T02:42:06.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.662+0000 7f5dd2ffd6c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] conn(0x7f5dc00dd110 0x7f5dc00fd520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.665 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.662+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 --> [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5dc00fdbd0 con 0x7f5dc00dd110 2026-02-13T02:42:06.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.660+0000 7f9fa17fa6c0 1 -- 10.20.193.78:0/3700101144 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f9c003dc0 con 0x7f9fa4114000 2026-02-13T02:42:06.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.664+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa4103160 con 0x7f9fa4114000 2026-02-13T02:42:06.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.664+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41037b0 con 0x7f9fa4114000 2026-02-13T02:42:06.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.660+0000 7f9fa17fa6c0 1 -- 10.20.193.78:0/3700101144 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f9c030e70 con 0x7f9fa4114000 2026-02-13T02:42:06.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.664+0000 7f9fa17fa6c0 1 -- 10.20.193.78:0/3700101144 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f9c008670 con 0x7f9fa4114000 2026-02-13T02:42:06.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.663+0000 7f5de227a6c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] conn(0x7f5dc00dd110 0x7f5dc00fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.663+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f5dcc0cb7c0 con 0x7f5ddc114000 2026-02-13T02:42:06.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.664+0000 7f5de12786c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5dc00b59a0 0x7f5dc00d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.664+0000 7f5de227a6c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] conn(0x7f5dc00dd110 0x7f5dc00fd520 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.664+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== osd.10 v2:10.20.193.91:6824/1302687241 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f5dc00fdbd0 con 0x7f5dc00dd110 2026-02-13T02:42:06.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.667+0000 7f9fa17fa6c0 1 -- 10.20.193.78:0/3700101144 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9f9c008800 con 0x7f9fa4114000 2026-02-13T02:42:06.670 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.668+0000 7f5de12786c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5dc00b59a0 0x7f5dc00d5e50 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ddc128280 tx=0x7f5dc4005e50 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.669+0000 7f9fa17fa6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f880be240 0x7f9f880de6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.669+0000 7f9fa17fa6c0 1 -- 10.20.193.78:0/3700101144 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9f9c10a350 con 0x7f9fa4114000 2026-02-13T02:42:06.671 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.670+0000 7f9fa37fe6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f880be240 0x7f9f880de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.672 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.670+0000 7f9fa37fe6c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f880be240 0x7f9f880de6f0 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa41036d0 tx=0x7f9f8c005df0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.682+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] conn(0x7f9f70001600 0x7f9f70021ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.682+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 --> [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f70024c10 con 0x7f9f70001600 2026-02-13T02:42:06.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.682+0000 7f9fa8d736c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] conn(0x7f9f70001600 0x7f9f70021ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.683+0000 7f9fa8d736c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] conn(0x7f9f70001600 0x7f9f70021ab0 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.684+0000 7f9fa17fa6c0 1 -- 10.20.193.78:0/3700101144 <== osd.6 v2:10.20.193.78:6818/1255269393 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f9f70024c10 con 0x7f9f70001600 2026-02-13T02:42:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.692+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 --> [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9f70023d00 con 0x7f9f70001600 2026-02-13T02:42:06.694 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.693+0000 7f9fa17fa6c0 1 -- 10.20.193.78:0/3700101144 <== osd.6 v2:10.20.193.78:6818/1255269393 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9f70023d00 con 0x7f9f70001600 2026-02-13T02:42:06.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.694+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] conn(0x7f9f70001600 msgr2=0x7f9f70021ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.694+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6818/1255269393,v1:10.20.193.78:6819/1255269393] conn(0x7f9f70001600 0x7f9f70021ab0 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.696 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.694+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f880be240 msgr2=0x7f9f880de6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.694+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f880be240 0x7f9f880de6f0 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fa41036d0 tx=0x7f9f8c005df0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.694+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fa4114000 msgr2=0x7f9fa40fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.697 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.694+0000 7f9fa95746c0 1 --2- 10.20.193.78:0/3700101144 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fa4114000 0x7f9fa40fcd40 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f9c0024b0 tx=0x7f9f9c0058a0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.695+0000 7f9fa8d736c0 1 -- 10.20.193.78:0/3700101144 reap_dead start 2026-02-13T02:42:06.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.695+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 shutdown_connections 2026-02-13T02:42:06.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.695+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 >> 10.20.193.78:0/3700101144 conn(0x7f9fa405aaa0 msgr2=0x7f9fa405d510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.695+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 shutdown_connections 2026-02-13T02:42:06.698 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.695+0000 7f9fa95746c0 1 -- 10.20.193.78:0/3700101144 wait complete. 2026-02-13T02:42:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.697+0000 7fb0f11616c0 1 -- 10.20.193.78:0/1495972122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec10f200 msgr2=0x7fb0ec10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.699 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.697+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/1495972122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec10f200 0x7fb0ec10f5d0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=16595519829041296723 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0e00099a0 tx=0x7fb0e002ed70 comp rx=0 tx=0).stop 2026-02-13T02:42:06.700 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.699+0000 7fb0f11616c0 1 -- 10.20.193.78:0/1495972122 shutdown_connections 2026-02-13T02:42:06.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.699+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/1495972122 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0ec115410 0x7fb0ec175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.699+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/1495972122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb0ec10fbf0 0x7fb0ec114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.699+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/1495972122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec10f200 0x7fb0ec10f5d0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=16595519829041296723 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.701 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.699+0000 7fb0f11616c0 1 -- 10.20.193.78:0/1495972122 >> 10.20.193.78:0/1495972122 conn(0x7fb0ec0ecb00 msgr2=0x7fb0ec10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.700+0000 7fb0f11616c0 1 -- 10.20.193.78:0/1495972122 shutdown_connections 2026-02-13T02:42:06.702 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.700+0000 7fb0f11616c0 1 -- 10.20.193.78:0/1495972122 wait complete. 2026-02-13T02:42:06.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.702+0000 7fb0f11616c0 1 Processor -- start 2026-02-13T02:42:06.703 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.702+0000 7fb0f11616c0 1 -- start start 2026-02-13T02:42:06.704 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.702+0000 7fb0f11616c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb0ec10f200 0x7fb0ec17d4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.702+0000 7fb0f11616c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec115410 0x7fb0ec17da30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0ead766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb0ec10f200 0x7fb0ec17d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0ead766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb0ec10f200 0x7fb0ec17d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60272/0 (socket says 10.20.193.78:60272) 2026-02-13T02:42:06.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0ead766c0 1 -- 10.20.193.78:0/3709535154 learned_addr learned my addr 10.20.193.78:0/3709535154 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.705 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0ec118cb0 0x7fb0ec119120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0eb5776c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0ec118cb0 0x7fb0ec119120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec119690 con 0x7fb0ec118cb0 2026-02-13T02:42:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec119800 con 0x7fb0ec10f200 2026-02-13T02:42:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec1199c0 con 0x7fb0ec115410 2026-02-13T02:42:06.706 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.703+0000 7fb0ea5756c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec115410 0x7fb0ec17da30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.704+0000 7fb0eb5776c0 1 -- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec115410 msgr2=0x7fb0ec17da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.704+0000 7fb0eb5776c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec115410 0x7fb0ec17da30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.704+0000 7fb0eb5776c0 1 -- 10.20.193.78:0/3709535154 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb0ec10f200 msgr2=0x7fb0ec17d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.704+0000 7fb0eb5776c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb0ec10f200 0x7fb0ec17d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.704+0000 7fb0eb5776c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc00a5b0 con 0x7fb0ec118cb0 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.704+0000 7fb0ea5756c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb0ec115410 0x7fb0ec17da30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.704+0000 7fb0eb5776c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0ec118cb0 0x7fb0ec119120 secure :-1 s=READY pgs=187 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0dc006fd0 tx=0x7fb0dc00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.705+0000 7fb0ead766c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb0ec10f200 0x7fb0ec17d4f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.705+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0dc00daa0 con 0x7fb0ec118cb0 2026-02-13T02:42:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.705+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb0dc00a070 con 0x7fb0ec118cb0 2026-02-13T02:42:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.705+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0dc00daa0 con 0x7fb0ec118cb0 2026-02-13T02:42:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.706+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e0009590 con 0x7fb0ec118cb0 2026-02-13T02:42:06.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.709+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fb0dc0081c0 con 0x7fb0ec118cb0 2026-02-13T02:42:06.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.709+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ec15a140 con 0x7fb0ec118cb0 2026-02-13T02:42:06.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0ec052a50 con 0x7fb0ec118cb0 2026-02-13T02:42:06.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 -- 10.20.193.78:0/254164190 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00c8c10 msgr2=0x7f16b00cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 --2- 10.20.193.78:0/254164190 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00c8c10 0x7f16b00cdc50 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=1404375642499118071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16a00098a0 tx=0x7f16a002ec40 comp rx=0 tx=0).stop 2026-02-13T02:42:06.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 -- 10.20.193.78:0/254164190 shutdown_connections 2026-02-13T02:42:06.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 --2- 10.20.193.78:0/254164190 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f16b00ce430 0x7f16b012edd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 --2- 10.20.193.78:0/254164190 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00c8c10 0x7f16b00cdc50 unknown :-1 s=CLOSED pgs=110 gs=2 cs=0 l=1 c_cookie=1404375642499118071 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 --2- 10.20.193.78:0/254164190 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16b00c8220 0x7f16b00c85f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 -- 10.20.193.78:0/254164190 >> 10.20.193.78:0/254164190 conn(0x7f16b00a5aa0 msgr2=0x7f16b00c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 -- 10.20.193.78:0/254164190 shutdown_connections 2026-02-13T02:42:06.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.712+0000 7f16be8586c0 1 -- 10.20.193.78:0/254164190 wait complete. 2026-02-13T02:42:06.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7fb0cbfff6c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb0cc0b57c0 0x7fb0cc0d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb0dc0e7070 con 0x7fb0ec118cb0 2026-02-13T02:42:06.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7fb0cbfff6c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] conn(0x7fb0cc0dcf30 0x7fb0cc0fd340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0cc0fd9f0 con 0x7fb0cc0dcf30 2026-02-13T02:42:06.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fb0dc0e73c0 con 0x7fb0ec118cb0 2026-02-13T02:42:06.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7fb0ead766c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb0cc0b57c0 0x7fb0cc0d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7fb0ea5756c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] conn(0x7fb0cc0dcf30 0x7fb0cc0fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7fb0ead766c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb0cc0b57c0 0x7fb0cc0d5c70 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0e00098c0 tx=0x7fb0e002f850 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7f16be8586c0 1 Processor -- start 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.714+0000 7f16be8586c0 1 -- start start 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.715+0000 7f16be8586c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16b00c8220 0x7f16b00adab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.715+0000 7f16be8586c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00ce430 0x7f16b012ecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.715+0000 7f16be8586c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f16b00ae0e0 0x7f16b00b3360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.715+0000 7f16be8586c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16b00ae7d0 con 0x7f16b00c8220 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.715+0000 7f16be8586c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f16b00b38a0 con 0x7f16b00ce430 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.715+0000 7f16be8586c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16b00b3a60 con 0x7f16b00ae0e0 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.715+0000 7f16af7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00ce430 0x7f16b012ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16affff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16b00c8220 0x7f16b00adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16bd5cb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f16b00ae0e0 0x7f16b00b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16bd5cb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f16b00ae0e0 0x7f16b00b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45496/0 (socket says 10.20.193.78:45496) 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16bd5cb6c0 1 -- 10.20.193.78:0/256273020 learned_addr learned my addr 10.20.193.78:0/256273020 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16affff6c0 1 -- 10.20.193.78:0/256273020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f16b00ae0e0 msgr2=0x7f16b00b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16affff6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f16b00ae0e0 0x7f16b00b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16affff6c0 1 -- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00ce430 msgr2=0x7f16b012ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16affff6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00ce430 0x7f16b012ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16affff6c0 1 -- 10.20.193.78:0/256273020 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a00094c0 con 0x7f16b00c8220 2026-02-13T02:42:06.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.716+0000 7f16af7fe6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16b00ce430 0x7f16b012ecd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:06.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7fb0ea5756c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] conn(0x7fb0cc0dcf30 0x7fb0cc0fd340 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7f16affff6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16b00c8220 0x7f16b00adab0 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16a8005b40 tx=0x7f16a800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16a8004130 con 0x7f16b00c8220 2026-02-13T02:42:06.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b00b3d40 con 0x7f16b00c8220 2026-02-13T02:42:06.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16a8004290 con 0x7f16b00c8220 2026-02-13T02:42:06.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16a800cd20 con 0x7f16b00c8220 2026-02-13T02:42:06.722 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.718+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== osd.5 v2:10.20.193.154:6808/1052719265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fb0cc0fd9f0 con 0x7fb0cc0dcf30 2026-02-13T02:42:06.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.718+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b00b44d0 con 0x7f16b00c8220 2026-02-13T02:42:06.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.720+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16b0000e10 con 0x7f16b00c8220 2026-02-13T02:42:06.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7fa17690c6c0 1 -- 10.20.193.78:0/1436550281 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 msgr2=0x7fa1680c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.717+0000 7fa17690c6c0 1 --2- 10.20.193.78:0/1436550281 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 0x7fa1680c3df0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=7640564464385917310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa160009970 tx=0x7fa16002ed10 comp rx=0 tx=0).stop 2026-02-13T02:42:06.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.719+0000 7fa17690c6c0 1 -- 10.20.193.78:0/1436550281 shutdown_connections 2026-02-13T02:42:06.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.719+0000 7fa17690c6c0 1 --2- 10.20.193.78:0/1436550281 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa1680c5610 0x7fa1680c5ab0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.719+0000 7fa17690c6c0 1 --2- 10.20.193.78:0/1436550281 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa1680c4330 0x7fa1680c4760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.719+0000 7fa17690c6c0 1 --2- 10.20.193.78:0/1436550281 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 0x7fa1680c3df0 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=7640564464385917310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.719+0000 7fa17690c6c0 1 -- 10.20.193.78:0/1436550281 >> 10.20.193.78:0/1436550281 conn(0x7fa16801cdf0 msgr2=0x7fa16801d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.719+0000 7fa17690c6c0 1 -- 10.20.193.78:0/1436550281 shutdown_connections 2026-02-13T02:42:06.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.719+0000 7fa17690c6c0 1 -- 10.20.193.78:0/1436550281 wait complete. 2026-02-13T02:42:06.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.721+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f16a80026b0 con 0x7f16b00c8220 2026-02-13T02:42:06.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.720+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 --> [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ddc114c40 con 0x7f5dc00dd110 2026-02-13T02:42:06.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.723+0000 7f16ad7fa6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f16840b58b0 0x7f16840d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.724+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f16a80e39e0 con 0x7f16b00c8220 2026-02-13T02:42:06.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.724+0000 7f16ad7fa6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] conn(0x7f16840dd020 0x7f16840fd430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.724+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 --> [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16840fdae0 con 0x7f16840dd020 2026-02-13T02:42:06.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.724+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f16a80e8070 con 0x7f16b00c8220 2026-02-13T02:42:06.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.724+0000 7f16af7fe6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f16840b58b0 0x7f16840d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7fa0435776c0 1 -- 10.20.193.78:0/3729509558 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0c1540 msgr2=0x7fa03c121ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7fa0435776c0 1 --2- 10.20.193.78:0/3729509558 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0c1540 0x7fa03c121ee0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=14257458685505665771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa03400a9b0 tx=0x7fa03402fda0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7f16bd5cb6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] conn(0x7f16840dd020 0x7f16840fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7fa0435776c0 1 -- 10.20.193.78:0/3729509558 shutdown_connections 2026-02-13T02:42:06.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7fa0435776c0 1 --2- 10.20.193.78:0/3729509558 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0c1540 0x7fa03c121ee0 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=14257458685505665771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7fa0435776c0 1 --2- 10.20.193.78:0/3729509558 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa03c0bbd20 0x7fa03c0c0d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7fa0435776c0 1 --2- 10.20.193.78:0/3729509558 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa03c0bb330 0x7fa03c0bb700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.725+0000 7fa0435776c0 1 -- 10.20.193.78:0/3729509558 >> 10.20.193.78:0/3729509558 conn(0x7fa03c00c420 msgr2=0x7fa03c00c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.726+0000 7fa0435776c0 1 -- 10.20.193.78:0/3729509558 shutdown_connections 2026-02-13T02:42:06.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.726+0000 7fa0435776c0 1 -- 10.20.193.78:0/3729509558 wait complete. 2026-02-13T02:42:06.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa0435776c0 1 Processor -- start 2026-02-13T02:42:06.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa0435776c0 1 -- start start 2026-02-13T02:42:06.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7f16bd5cb6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] conn(0x7f16840dd020 0x7f16840fd430 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.726+0000 7fa17690c6c0 1 Processor -- start 2026-02-13T02:42:06.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.726+0000 7fa17690c6c0 1 -- start start 2026-02-13T02:42:06.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17690c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa1680c4330 0x7fa1680db800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17690c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa1680c5610 0x7fa1680dbd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17690c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 0x7fa1680e1100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17690c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa1680e1750 con 0x7fa1680c5610 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17690c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa1680e18c0 con 0x7fa1680cbb30 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17690c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa1680e1a80 con 0x7fa1680c4330 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17590a6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa1680c4330 0x7fa1680db800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17590a6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa1680c4330 0x7fa1680db800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45508/0 (socket says 10.20.193.78:45508) 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17590a6c0 1 -- 10.20.193.78:0/3415123247 learned_addr learned my addr 10.20.193.78:0/3415123247 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.731 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.727+0000 7fa17610b6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 0x7fa1680e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7fa0435776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa03c0bb330 0x7fa03c0c9240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7fa17610b6c0 1 -- 10.20.193.78:0/3415123247 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa1680c4330 msgr2=0x7fa1680db800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7fa17610b6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa1680c4330 0x7fa1680db800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7fa17610b6c0 1 -- 10.20.193.78:0/3415123247 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa1680c5610 msgr2=0x7fa1680dbd40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:42:06.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.729+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== osd.1 v2:10.20.193.91:6800/196768757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f16840fdae0 con 0x7f16840dd020 2026-02-13T02:42:06.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.729+0000 7fa17610b6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa1680c5610 0x7fa1680dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.733 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.730+0000 7fa17610b6c0 1 -- 10.20.193.78:0/3415123247 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa160009590 con 0x7fa1680cbb30 2026-02-13T02:42:06.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.730+0000 7fa0425756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa03c0bb330 0x7fa03c0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.734 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.730+0000 7fa0425756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa03c0bb330 0x7fa03c0c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34090/0 (socket says 10.20.193.78:34090) 2026-02-13T02:42:06.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.730+0000 7fa17610b6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 0x7fa1680e1100 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa16c006fd0 tx=0x7fa16c00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.731+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa16c003c40 con 0x7fa1680cbb30 2026-02-13T02:42:06.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.731+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa16c00a070 con 0x7fa1680cbb30 2026-02-13T02:42:06.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.731+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1680e1d60 con 0x7fa1680cbb30 2026-02-13T02:42:06.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.731+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa168122440 con 0x7fa1680cbb30 2026-02-13T02:42:06.735 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa0435776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa03c0c1540 0x7fa03c0c9780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa16c005250 con 0x7fa1680cbb30 2026-02-13T02:42:06.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa0435776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0ceb40 0x7fa03c0cefe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa13c000fe0 con 0x7fa1680cbb30 2026-02-13T02:42:06.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa0435776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0cf550 con 0x7fa03c0bb330 2026-02-13T02:42:06.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa0435776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0cf6c0 con 0x7fa03c0c1540 2026-02-13T02:42:06.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa0435776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c0cf880 con 0x7fa03c0ceb40 2026-02-13T02:42:06.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa041d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa03c0c1540 0x7fa03c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0ceb40 0x7fa03c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0ceb40 0x7fa03c0cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45510/0 (socket says 10.20.193.78:45510) 2026-02-13T02:42:06.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 -- 10.20.193.78:0/4107725423 learned_addr learned my addr 10.20.193.78:0/4107725423 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 -- 10.20.193.78:0/4107725423 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa03c0c1540 msgr2=0x7fa03c0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa03c0c1540 0x7fa03c0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 -- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa03c0bb330 msgr2=0x7fa03c0c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa03c0bb330 0x7fa03c0c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 -- 10.20.193.78:0/4107725423 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03400a5b0 con 0x7fa03c0ceb40 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.732+0000 7fa042d766c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0ceb40 0x7fa03c0cefe0 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa03400a2e0 tx=0x7fa034030ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.733+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa034005b20 con 0x7fa03c0ceb40 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.733+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03c10fcd0 con 0x7fa03c0ceb40 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.733+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa034003cf0 con 0x7fa03c0ceb40 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.733+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa034005b20 con 0x7fa03c0ceb40 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.733+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03c110100 con 0x7fa03c0ceb40 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.734+0000 7fa0425756c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa03c0bb330 0x7fa03c0c9240 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2026-02-13T02:42:06.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.735+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa03c000e30 con 0x7fa03c0ceb40 2026-02-13T02:42:06.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.735+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 --> [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb0ec064910 con 0x7fb0cc0dcf30 2026-02-13T02:42:06.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.735+0000 7fb0cbfff6c0 1 -- 10.20.193.78:0/3709535154 <== osd.5 v2:10.20.193.154:6808/1052719265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb0ec064910 con 0x7fb0cc0dcf30 2026-02-13T02:42:06.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.736+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa034005c80 con 0x7fa03c0ceb40 2026-02-13T02:42:06.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.737+0000 7fa02b7fe6c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa01c0b57c0 0x7fa01c0d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.737+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa034119f10 con 0x7fa03c0ceb40 2026-02-13T02:42:06.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.737+0000 7fa02b7fe6c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] conn(0x7fa01c0dcf30 0x7fa01c0fd340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.737+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 --> [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa01c0fd9f0 con 0x7fa01c0dcf30 2026-02-13T02:42:06.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.737+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa03411c5a0 con 0x7fa03c0ceb40 2026-02-13T02:42:06.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] conn(0x7fb0cc0dcf30 msgr2=0x7fb0cc0fd340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fa0425756c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa01c0b57c0 0x7fa01c0d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.154:6808/1052719265,v1:10.20.193.154:6809/1052719265] conn(0x7fb0cc0dcf30 0x7fb0cc0fd340 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb0cc0b57c0 msgr2=0x7fb0cc0d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb0cc0b57c0 0x7fb0cc0d5c70 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0e00098c0 tx=0x7fb0e002f850 comp rx=0 tx=0).stop 2026-02-13T02:42:06.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0ec118cb0 msgr2=0x7fb0ec119120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fb0f11616c0 1 --2- 10.20.193.78:0/3709535154 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0ec118cb0 0x7fb0ec119120 secure :-1 s=READY pgs=187 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0dc006fd0 tx=0x7fb0dc00d040 comp rx=0 tx=0).stop 2026-02-13T02:42:06.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.739+0000 7fb0eb5776c0 1 -- 10.20.193.78:0/3709535154 reap_dead start 2026-02-13T02:42:06.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.740+0000 7fa0425756c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa01c0b57c0 0x7fa01c0d5c70 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa038004750 tx=0x7fa03800b420 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.742+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 shutdown_connections 2026-02-13T02:42:06.743 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.742+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 >> 10.20.193.78:0/3709535154 conn(0x7fb0ec0ecb00 msgr2=0x7fb0ec10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.744 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.742+0000 7fa041d746c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] conn(0x7fa01c0dcf30 0x7fa01c0fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.743+0000 7fa041d746c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] conn(0x7fa01c0dcf30 0x7fa01c0fd340 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.720+0000 7f5dd2ffd6c0 1 -- 10.20.193.78:0/1878420798 <== osd.10 v2:10.20.193.91:6824/1302687241 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5ddc114c40 con 0x7f5dc00dd110 2026-02-13T02:42:06.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.720+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] conn(0x7f5dc00dd110 msgr2=0x7f5dc00fd520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.721+0000 7f5dd0ff96c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.91:6824/1302687241,v1:10.20.193.91:6825/1302687241] conn(0x7f5dc00dd110 0x7f5dc00fd520 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.721+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5dc00b59a0 msgr2=0x7f5dc00d5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.745 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.721+0000 7f5dd0ff96c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f5dc00b59a0 0x7f5dc00d5e50 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ddc128280 tx=0x7f5dc4005e50 comp rx=0 tx=0).stop 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.721+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 msgr2=0x7f5ddc1218f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.721+0000 7f5dd0ff96c0 1 --2- 10.20.193.78:0/1878420798 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ddc114000 0x7f5ddc1218f0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dcc031460 tx=0x7f5dcc0054b0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.721+0000 7f5de227a6c0 1 -- 10.20.193.78:0/1878420798 reap_dead start 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 shutdown_connections 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 >> 10.20.193.78:0/1878420798 conn(0x7f5ddc05aaa0 msgr2=0x7f5ddc119c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 shutdown_connections 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.728+0000 7f5dd0ff96c0 1 -- 10.20.193.78:0/1878420798 wait complete. 2026-02-13T02:42:06.746 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.744+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== osd.3 v2:10.20.193.78:6810/71468509 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa01c0fd9f0 con 0x7fa01c0dcf30 2026-02-13T02:42:06.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.748+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 shutdown_connections 2026-02-13T02:42:06.749 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.748+0000 7fb0f11616c0 1 -- 10.20.193.78:0/3709535154 wait complete. 2026-02-13T02:42:06.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.742+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 --> [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f16b01324a0 con 0x7f16840dd020 2026-02-13T02:42:06.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.742+0000 7f16ad7fa6c0 1 -- 10.20.193.78:0/256273020 <== osd.1 v2:10.20.193.91:6800/196768757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f16b01324a0 con 0x7f16840dd020 2026-02-13T02:42:06.750 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.746+0000 7f16af7fe6c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f16840b58b0 0x7f16840d5d60 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b00b43f0 tx=0x7f16a00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.754+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] conn(0x7f16840dd020 msgr2=0x7f16840fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.754+0000 7f16be8586c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.91:6800/196768757,v1:10.20.193.91:6801/196768757] conn(0x7f16840dd020 0x7f16840fd430 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.754+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f16840b58b0 msgr2=0x7f16840d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.754+0000 7f16be8586c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f16840b58b0 0x7f16840d5d60 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16b00b43f0 tx=0x7f16a00023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.754+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16b00c8220 msgr2=0x7f16b00adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.754+0000 7f16be8586c0 1 --2- 10.20.193.78:0/256273020 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16b00c8220 0x7f16b00adab0 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16a8005b40 tx=0x7f16a800bed0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.755+0000 7f16bd5cb6c0 1 -- 10.20.193.78:0/256273020 reap_dead start 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.755+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 shutdown_connections 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.755+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 >> 10.20.193.78:0/256273020 conn(0x7f16b00a5aa0 msgr2=0x7f16b00c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.755+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 shutdown_connections 2026-02-13T02:42:06.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.755+0000 7f16be8586c0 1 -- 10.20.193.78:0/256273020 wait complete. 2026-02-13T02:42:06.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.743+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa16c0053f0 con 0x7fa1680cbb30 2026-02-13T02:42:06.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.752+0000 7fa15effd6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa1440b5660 0x7fa1440d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.758+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa16c0e4cb0 con 0x7fa1680cbb30 2026-02-13T02:42:06.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.758+0000 7fa15effd6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] conn(0x7fa1440dcc60 0x7fa1440fd070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:06.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.758+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 --> [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1440fd720 con 0x7fa1440dcc60 2026-02-13T02:42:06.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.758+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7fa16c0e50d0 con 0x7fa1680cbb30 2026-02-13T02:42:06.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.759+0000 7fa1751096c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] conn(0x7fa1440dcc60 0x7fa1440fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.759+0000 7fa17590a6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa1440b5660 0x7fa1440d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:06.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.761+0000 7fa1751096c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] conn(0x7fa1440dcc60 0x7fa1440fd070 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.764 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.762+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 --> [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa03c125590 con 0x7fa01c0dcf30 2026-02-13T02:42:06.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.762+0000 7fa17590a6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa1440b5660 0x7fa1440d5b10 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa160031fd0 tx=0x7fa160005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:06.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.764+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== osd.11 v2:10.20.193.154:6824/1149779767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa1440fd720 con 0x7fa1440dcc60 2026-02-13T02:42:06.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa02b7fe6c0 1 -- 10.20.193.78:0/4107725423 <== osd.3 v2:10.20.193.78:6810/71468509 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa02c009880 con 0x7fa01c0dcf30 2026-02-13T02:42:06.768 INFO:teuthology.orchestra.run.trial078.stdout:219043332111 2026-02-13T02:42:06.769 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] conn(0x7fa01c0dcf30 msgr2=0x7fa01c0fd340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6810/71468509,v1:10.20.193.78:6811/71468509] conn(0x7fa01c0dcf30 0x7fa01c0fd340 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa01c0b57c0 msgr2=0x7fa01c0d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa01c0b57c0 0x7fa01c0d5c70 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa038004750 tx=0x7fa03800b420 comp rx=0 tx=0).stop 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0ceb40 msgr2=0x7fa03c0cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 --2- 10.20.193.78:0/4107725423 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa03c0ceb40 0x7fa03c0cefe0 secure :-1 s=READY pgs=105 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa03400a2e0 tx=0x7fa034030ef0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa042d766c0 1 -- 10.20.193.78:0/4107725423 reap_dead start 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 shutdown_connections 2026-02-13T02:42:06.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 >> 10.20.193.78:0/4107725423 conn(0x7fa03c00c420 msgr2=0x7fa03c0b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.766+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 shutdown_connections 2026-02-13T02:42:06.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.767+0000 7fa0435776c0 1 -- 10.20.193.78:0/4107725423 wait complete. 2026-02-13T02:42:06.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.773+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 --> [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa13c002d20 con 0x7fa1440dcc60 2026-02-13T02:42:06.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.773+0000 7fa15effd6c0 1 -- 10.20.193.78:0/3415123247 <== osd.11 v2:10.20.193.154:6824/1149779767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa13c002d20 con 0x7fa1440dcc60 2026-02-13T02:42:06.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.774+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 >> [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] conn(0x7fa1440dcc60 msgr2=0x7fa1440fd070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.774+0000 7fa17690c6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.154:6824/1149779767,v1:10.20.193.154:6825/1149779767] conn(0x7fa1440dcc60 0x7fa1440fd070 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:06.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.774+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa1440b5660 msgr2=0x7fa1440d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.774+0000 7fa17690c6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa1440b5660 0x7fa1440d5b10 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa160031fd0 tx=0x7fa160005910 comp rx=0 tx=0).stop 2026-02-13T02:42:06.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.774+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 msgr2=0x7fa1680e1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:06.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.774+0000 7fa17690c6c0 1 --2- 10.20.193.78:0/3415123247 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa1680cbb30 0x7fa1680e1100 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa16c006fd0 tx=0x7fa16c00cc00 comp rx=0 tx=0).stop 2026-02-13T02:42:06.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.774+0000 7fa17610b6c0 1 -- 10.20.193.78:0/3415123247 reap_dead start 2026-02-13T02:42:06.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.777+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 shutdown_connections 2026-02-13T02:42:06.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.782+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 >> 10.20.193.78:0/3415123247 conn(0x7fa16801cdf0 msgr2=0x7fa1680c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:06.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.783+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 shutdown_connections 2026-02-13T02:42:06.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:06.783+0000 7fa17690c6c0 1 -- 10.20.193.78:0/3415123247 wait complete. 2026-02-13T02:42:06.798 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:06 trial078 ceph-mon[22944]: pgmap v185: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 10 KiB/s wr, 24 op/s 2026-02-13T02:42:06.798 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:06 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4220838547' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:06.865 INFO:teuthology.orchestra.run.trial078.stdout:124554051605 2026-02-13T02:42:06.866 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T02:42:06.886 INFO:teuthology.orchestra.run.trial078.stdout:188978561040 2026-02-13T02:42:06.887 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T02:42:06.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:06 trial091 ceph-mon[27614]: pgmap v185: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 10 KiB/s wr, 24 op/s 2026-02-13T02:42:06.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:06 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4220838547' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:07.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:06 trial154 ceph-mon[27921]: pgmap v185: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 10 KiB/s wr, 24 op/s 2026-02-13T02:42:07.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:06 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4220838547' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:42:07.172 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.189 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.192 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.203 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.216 INFO:teuthology.orchestra.run.trial078.stdout:171798691857 2026-02-13T02:42:07.216 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T02:42:07.238 INFO:teuthology.orchestra.run.trial078.stdout:47244640282 2026-02-13T02:42:07.239 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T02:42:07.241 INFO:teuthology.orchestra.run.trial078.stdout:34359738397 2026-02-13T02:42:07.241 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T02:42:07.242 INFO:teuthology.orchestra.run.trial078.stdout:94489280535 2026-02-13T02:42:07.246 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T02:42:07.269 INFO:teuthology.orchestra.run.trial078.stdout:300647710730 2026-02-13T02:42:07.270 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T02:42:07.275 INFO:teuthology.orchestra.run.trial078.stdout:141733920787 2026-02-13T02:42:07.276 INFO:teuthology.orchestra.run.trial078.stdout:249108103181 2026-02-13T02:42:07.276 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T02:42:07.277 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T02:42:07.280 INFO:teuthology.orchestra.run.trial078.stdout:270582939658 2026-02-13T02:42:07.280 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T02:42:07.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/1816543929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 msgr2=0x7fcf48114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/1816543929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf48114210 secure :-1 s=READY pgs=189 gs=2 cs=0 l=1 c_cookie=7800072903832856368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf380098a0 tx=0x7fcf3802ec50 comp rx=0 tx=0).stop 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/1816543929 shutdown_connections 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/1816543929 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcf481149c0 0x7fcf48114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/1816543929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf48114210 unknown :-1 s=CLOSED pgs=189 gs=2 cs=0 l=1 c_cookie=7800072903832856368 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/1816543929 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcf4811b510 0x7fcf4811b8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/1816543929 >> 10.20.193.78:0/1816543929 conn(0x7fcf48058a50 msgr2=0x7fcf48058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/1816543929 shutdown_connections 2026-02-13T02:42:07.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/1816543929 wait complete. 2026-02-13T02:42:07.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.466+0000 7fcf4ea016c0 1 Processor -- start 2026-02-13T02:42:07.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.462+0000 7faef100b6c0 1 -- 10.20.193.78:0/2077238473 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec10b730 msgr2=0x7faeec110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.462+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2077238473 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec10b730 0x7faeec110590 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=10298885975477832335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faed80098a0 tx=0x7faed802ec50 comp rx=0 tx=0).stop 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.463+0000 7faef100b6c0 1 -- 10.20.193.78:0/2077238473 shutdown_connections 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.463+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2077238473 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faeec110d40 0x7faeec111700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.463+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2077238473 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec10b730 0x7faeec110590 unknown :-1 s=CLOSED pgs=113 gs=2 cs=0 l=1 c_cookie=10298885975477832335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.463+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2077238473 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faeec10ad40 0x7faeec10b110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.463+0000 7faef100b6c0 1 -- 10.20.193.78:0/2077238473 >> 10.20.193.78:0/2077238473 conn(0x7faeec0638a0 msgr2=0x7faeec109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.463+0000 7faef100b6c0 1 -- 10.20.193.78:0/2077238473 shutdown_connections 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.463+0000 7faef100b6c0 1 -- 10.20.193.78:0/2077238473 wait complete. 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.464+0000 7faef100b6c0 1 Processor -- start 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.464+0000 7faef100b6c0 1 -- start start 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faef100b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faeec10ad40 0x7faeec11a5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faef100b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec110d40 0x7faeec11ab10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faef100b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faeec11fed0 0x7faeec120370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faeeb7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec110d40 0x7faeec11ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faef100b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7faeec1208e0 con 0x7faeec11fed0 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faef100b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7faeec120a50 con 0x7faeec110d40 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faef100b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7faeec120c10 con 0x7faeec10ad40 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faeeb7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec110d40 0x7faeec11ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60364/0 (socket says 10.20.193.78:60364) 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faeeb7fe6c0 1 -- 10.20.193.78:0/2679504562 learned_addr learned my addr 10.20.193.78:0/2679504562 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faeebfff6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faeec10ad40 0x7faeec11a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faeeb7fe6c0 1 -- 10.20.193.78:0/2679504562 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faeec10ad40 msgr2=0x7faeec11a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.465+0000 7faeeb7fe6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faeec10ad40 0x7faeec11a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.466+0000 7faeeb7fe6c0 1 -- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faeec11fed0 msgr2=0x7faeec120370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.466+0000 7faeeb7fe6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faeec11fed0 0x7faeec120370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.466+0000 7faeeb7fe6c0 1 -- 10.20.193.78:0/2679504562 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee000a5b0 con 0x7faeec110d40 2026-02-13T02:42:07.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.466+0000 7faeeb7fe6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec110d40 0x7faeec11ab10 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faed802f8a0 tx=0x7faed8002960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.466+0000 7fcf4ea016c0 1 -- start start 2026-02-13T02:42:07.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf4ea016c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf4812b870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf4ea016c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcf481149c0 0x7fcf4812bdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf47fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf4812b870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf4ea016c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcf4811b510 0x7fcf48131170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf4ea016c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf481317c0 con 0x7fcf48113dc0 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf47fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf4812b870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34114/0 (socket says 10.20.193.78:34114) 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf4ea016c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48131930 con 0x7fcf481149c0 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf4ea016c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48131af0 con 0x7fcf4811b510 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf47fff6c0 1 -- 10.20.193.78:0/499153251 learned_addr learned my addr 10.20.193.78:0/499153251 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf477fe6c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcf481149c0 0x7fcf4812bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7fcf4cf736c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcf4811b510 0x7fcf48131170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.468+0000 7fcf47fff6c0 1 -- 10.20.193.78:0/499153251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcf4811b510 msgr2=0x7fcf48131170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.468+0000 7fcf47fff6c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcf4811b510 0x7fcf48131170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.468+0000 7fcf47fff6c0 1 -- 10.20.193.78:0/499153251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcf481149c0 msgr2=0x7fcf4812bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.468+0000 7fcf47fff6c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcf481149c0 0x7fcf4812bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.468+0000 7fcf47fff6c0 1 -- 10.20.193.78:0/499153251 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf380094c0 con 0x7fcf48113dc0 2026-02-13T02:42:07.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.469+0000 7fcf47fff6c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf4812b870 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf3400b800 tx=0x7fcf3400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.469+0000 7fcf457fa6c0 1 -- 10.20.193.78:0/499153251 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf34004a80 con 0x7fcf48113dc0 2026-02-13T02:42:07.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.470+0000 7fcf457fa6c0 1 -- 10.20.193.78:0/499153251 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcf34009030 con 0x7fcf48113dc0 2026-02-13T02:42:07.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.470+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf48131dd0 con 0x7fcf48113dc0 2026-02-13T02:42:07.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.470+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481724b0 con 0x7fcf48113dc0 2026-02-13T02:42:07.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.470+0000 7fcf457fa6c0 1 -- 10.20.193.78:0/499153251 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf3400cdb0 con 0x7fcf48113dc0 2026-02-13T02:42:07.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.471+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4805b000 con 0x7fcf48113dc0 2026-02-13T02:42:07.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7faee97fa6c0 1 -- 10.20.193.78:0/2679504562 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faed80045d0 con 0x7faeec110d40 2026-02-13T02:42:07.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.475+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/3022686641 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe981149f0 msgr2=0x7fbe981161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.475+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/3022686641 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe981149f0 0x7fbe981161e0 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=9253015931244911529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe8c009fd0 tx=0x7fbe8c02f5c0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7faee97fa6c0 1 -- 10.20.193.78:0/2679504562 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faed80076a0 con 0x7faeec110d40 2026-02-13T02:42:07.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.467+0000 7faee97fa6c0 1 -- 10.20.193.78:0/2679504562 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faed8036660 con 0x7faeec110d40 2026-02-13T02:42:07.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.468+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed80094c0 con 0x7faeec110d40 2026-02-13T02:42:07.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.468+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec1612d0 con 0x7faeec110d40 2026-02-13T02:42:07.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.469+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb0005310 con 0x7faeec110d40 2026-02-13T02:42:07.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/3022686641 shutdown_connections 2026-02-13T02:42:07.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/3022686641 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98116990 0x7fbe9817a5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/3022686641 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe981149f0 0x7fbe981161e0 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=9253015931244911529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/3022686641 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbe98114000 0x7fbe981143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/3022686641 >> 10.20.193.78:0/3022686641 conn(0x7fbe9805aaa0 msgr2=0x7fbe9805b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/3022686641 shutdown_connections 2026-02-13T02:42:07.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.475+0000 7fcf457fa6c0 1 -- 10.20.193.78:0/499153251 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fcf34004060 con 0x7fcf48113dc0 2026-02-13T02:42:07.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fcf457fa6c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcf240b5760 0x7fcf240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fcf457fa6c0 1 -- 10.20.193.78:0/499153251 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fcf340e3bd0 con 0x7fcf48113dc0 2026-02-13T02:42:07.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fcf457fa6c0 1 -- 10.20.193.78:0/499153251 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcf3411c660 con 0x7fcf48113dc0 2026-02-13T02:42:07.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fcf477fe6c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcf240b5760 0x7fcf240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.478+0000 7fcf477fe6c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcf240b5760 0x7fcf240d5c10 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf48132200 tx=0x7fcf380023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.477+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/3022686641 wait complete. 2026-02-13T02:42:07.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.480+0000 7faee97fa6c0 1 -- 10.20.193.78:0/2679504562 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7faed80071c0 con 0x7faeec110d40 2026-02-13T02:42:07.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.488+0000 7fd28ff806c0 1 -- 10.20.193.78:0/1178987264 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288116b30 msgr2=0x7fd28817a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.488+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/1178987264 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288116b30 0x7fd28817a760 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=2918543912124918263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd274009fd0 tx=0x7fd27402f5e0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.488+0000 7fd28ff806c0 1 -- 10.20.193.78:0/1178987264 shutdown_connections 2026-02-13T02:42:07.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.489+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/1178987264 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288116b30 0x7fd28817a760 unknown :-1 s=CLOSED pgs=191 gs=1 cs=0 l=1 c_cookie=2918543912124918263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.489+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/1178987264 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2881149f0 0x7fd288116380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.489+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/1178987264 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd288114000 0x7fd2881143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.489+0000 7fd28ff806c0 1 -- 10.20.193.78:0/1178987264 >> 10.20.193.78:0/1178987264 conn(0x7fd2880586e0 msgr2=0x7fd288058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.489+0000 7fd28ff806c0 1 -- 10.20.193.78:0/1178987264 shutdown_connections 2026-02-13T02:42:07.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.489+0000 7fd28ff806c0 1 -- 10.20.193.78:0/1178987264 wait complete. 2026-02-13T02:42:07.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.490+0000 7fd28ff806c0 1 Processor -- start 2026-02-13T02:42:07.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.490+0000 7fd28ff806c0 1 -- start start 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28ff806c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288114000 0x7fd2880f4650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28ff806c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd288116b30 0x7fd28817a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28ff806c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2880f4cd0 0x7fd288105120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28ff806c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd288105660 con 0x7fd288114000 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28ff806c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd2881057d0 con 0x7fd2880f4cd0 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28ff806c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd288105990 con 0x7fd288116b30 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28dcf56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288114000 0x7fd2880f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.494 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28dcf56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288114000 0x7fd2880f4650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34142/0 (socket says 10.20.193.78:34142) 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.491+0000 7fd28dcf56c0 1 -- 10.20.193.78:0/310270303 learned_addr learned my addr 10.20.193.78:0/310270303 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.492+0000 7fd28d4f46c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd288116b30 0x7fd28817a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.492+0000 7fd28dcf56c0 1 -- 10.20.193.78:0/310270303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd288116b30 msgr2=0x7fd28817a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.492+0000 7fd28dcf56c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd288116b30 0x7fd28817a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.492+0000 7fd28dcf56c0 1 -- 10.20.193.78:0/310270303 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2880f4cd0 msgr2=0x7fd288105120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.492+0000 7fd28dcf56c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2880f4cd0 0x7fd288105120 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.492+0000 7fd28dcf56c0 1 -- 10.20.193.78:0/310270303 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd274009e40 con 0x7fd288114000 2026-02-13T02:42:07.495 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.492+0000 7fd28dcf56c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288114000 0x7fd2880f4650 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd280006e50 tx=0x7fd28000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.493+0000 7fd286ffd6c0 1 -- 10.20.193.78:0/310270303 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd280003c40 con 0x7fd288114000 2026-02-13T02:42:07.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.493+0000 7fd286ffd6c0 1 -- 10.20.193.78:0/310270303 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd28000a070 con 0x7fd288114000 2026-02-13T02:42:07.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.493+0000 7fd286ffd6c0 1 -- 10.20.193.78:0/310270303 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2800081c0 con 0x7fd288114000 2026-02-13T02:42:07.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.493+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd288105c70 con 0x7fd288114000 2026-02-13T02:42:07.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.493+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd288106100 con 0x7fd288114000 2026-02-13T02:42:07.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.495+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd288114fe0 con 0x7fd288114000 2026-02-13T02:42:07.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.496+0000 7fd286ffd6c0 1 -- 10.20.193.78:0/310270303 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fd28000d610 con 0x7fd288114000 2026-02-13T02:42:07.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.497+0000 7fd286ffd6c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd2580b5830 0x7fd2580d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.497+0000 7fd286ffd6c0 1 -- 10.20.193.78:0/310270303 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd2800e4ce0 con 0x7fd288114000 2026-02-13T02:42:07.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.498+0000 7fd28d4f46c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd2580b5830 0x7fd2580d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.498+0000 7fd286ffd6c0 1 -- 10.20.193.78:0/310270303 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2800a7630 con 0x7fd288114000 2026-02-13T02:42:07.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.499+0000 7fd28d4f46c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd2580b5830 0x7fd2580d5ce0 secure :-1 s=READY pgs=171 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2881198a0 tx=0x7fd278009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.478+0000 7fbe9ea9f6c0 1 Processor -- start 2026-02-13T02:42:07.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.478+0000 7fbe9ea9f6c0 1 -- start start 2026-02-13T02:42:07.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.478+0000 7fbe9ea9f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98114000 0x7fbe98121980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.478+0000 7fbe9ea9f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe98116990 0x7fbe98121ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9ea9f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbe98127280 0x7fbe98127720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98114000 0x7fbe98121980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98114000 0x7fbe98121980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45580/0 (socket says 10.20.193.78:45580) 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9ea9f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98127c90 con 0x7fbe98127280 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9ea9f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98127e00 con 0x7fbe98116990 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9ea9f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98127fc0 con 0x7fbe98114000 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9d29c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe98116990 0x7fbe98121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9d29c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe98116990 0x7fbe98121ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60402/0 (socket says 10.20.193.78:60402) 2026-02-13T02:42:07.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9e29e6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbe98127280 0x7fbe98127720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.523+0000 7faee97fa6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faed00b5760 0x7faed00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 -- 10.20.193.78:0/1200161304 learned_addr learned my addr 10.20.193.78:0/1200161304 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:07.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 -- 10.20.193.78:0/1200161304 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe98116990 msgr2=0x7fbe98121ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe98116990 0x7fbe98121ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 -- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbe98127280 msgr2=0x7fbe98127720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.528 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbe98127280 0x7fbe98127720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.479+0000 7fbe9da9d6c0 1 -- 10.20.193.78:0/1200161304 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c009e40 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.480+0000 7fbe9da9d6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98114000 0x7fbe98121980 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe8800b710 tx=0x7fbe8800bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.480+0000 7fbe86ffd6c0 1 -- 10.20.193.78:0/1200161304 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe88004250 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.480+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9817cf30 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.480+0000 7fbe86ffd6c0 1 -- 10.20.193.78:0/1200161304 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbe88009070 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.480+0000 7fbe86ffd6c0 1 -- 10.20.193.78:0/1200161304 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbe8800cdf0 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.480+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9817d3e0 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.483+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe981143d0 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.483+0000 7fbe86ffd6c0 1 -- 10.20.193.78:0/1200161304 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fbe880028c0 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.485+0000 7fbe86ffd6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbe600b56e0 0x7fbe600d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.485+0000 7fbe86ffd6c0 1 -- 10.20.193.78:0/1200161304 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbe880e3bc0 con 0x7fbe98114000 2026-02-13T02:42:07.529 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.486+0000 7fbe86ffd6c0 1 -- 10.20.193.78:0/1200161304 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbe880a6550 con 0x7fbe98114000 2026-02-13T02:42:07.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.494+0000 7fbe9d29c6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbe600b56e0 0x7fbe600d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.530 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.494+0000 7fbe9d29c6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbe600b56e0 0x7fbe600d5b90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe8c02fad0 tx=0x7fbe8c031f00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.523+0000 7faee97fa6c0 1 -- 10.20.193.78:0/2679504562 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7faed8107fe0 con 0x7faeec110d40 2026-02-13T02:42:07.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.573+0000 7faeebfff6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faed00b5760 0x7faed00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.573+0000 7faee97fa6c0 1 -- 10.20.193.78:0/2679504562 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faed81084d0 con 0x7faeec110d40 2026-02-13T02:42:07.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.573+0000 7faeebfff6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faed00b5760 0x7faed00d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faedc004750 tx=0x7faedc005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.577 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.612 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.613 INFO:teuthology.orchestra.run.trial078.stdout:188978561039 2026-02-13T02:42:07.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.610+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fbe9817f850 con 0x7fbe98114000 2026-02-13T02:42:07.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.610+0000 7fbe86ffd6c0 1 -- 10.20.193.78:0/1200161304 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbe880a9700 con 0x7fbe98114000 2026-02-13T02:42:07.622 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbe600b56e0 msgr2=0x7fbe600d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbe600b56e0 0x7fbe600d5b90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe8c02fad0 tx=0x7fbe8c031f00 comp rx=0 tx=0).stop 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98114000 msgr2=0x7fbe98121980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98114000 0x7fbe98121980 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe8800b710 tx=0x7fbe8800bbe0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 shutdown_connections 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbe600b56e0 0x7fbe600d5b90 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbe98127280 0x7fbe98127720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbe98116990 0x7fbe98121ec0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 --2- 10.20.193.78:0/1200161304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbe98114000 0x7fbe98121980 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 >> 10.20.193.78:0/1200161304 conn(0x7fbe9805aaa0 msgr2=0x7fbe9805d410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 shutdown_connections 2026-02-13T02:42:07.631 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.626+0000 7fbe9ea9f6c0 1 -- 10.20.193.78:0/1200161304 wait complete. 2026-02-13T02:42:07.635 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.638+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcf4812c9c0 con 0x7fcf48113dc0 2026-02-13T02:42:07.645 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.648 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.646+0000 7fcf457fa6c0 1 -- 10.20.193.78:0/499153251 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf340a6520 con 0x7fcf48113dc0 2026-02-13T02:42:07.649 INFO:teuthology.orchestra.run.trial078.stdout:64424509463 2026-02-13T02:42:07.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.625+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd2881143d0 con 0x7fd288114000 2026-02-13T02:42:07.649 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.643+0000 7fd286ffd6c0 1 -- 10.20.193.78:0/310270303 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd280003da0 con 0x7fd288114000 2026-02-13T02:42:07.649 INFO:teuthology.orchestra.run.trial078.stdout:124554051604 2026-02-13T02:42:07.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.646+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd2580b5830 msgr2=0x7fd2580d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.646+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd2580b5830 0x7fd2580d5ce0 secure :-1 s=READY pgs=171 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2881198a0 tx=0x7fd278009260 comp rx=0 tx=0).stop 2026-02-13T02:42:07.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.647+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288114000 msgr2=0x7fd2880f4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.647+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288114000 0x7fd2880f4650 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd280006e50 tx=0x7fd28000ced0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.648+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 shutdown_connections 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.648+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd2580b5830 0x7fd2580d5ce0 unknown :-1 s=CLOSED pgs=171 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.648+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2880f4cd0 0x7fd288105120 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.648+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd288116b30 0x7fd28817a6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.648+0000 7fd28ff806c0 1 --2- 10.20.193.78:0/310270303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd288114000 0x7fd2880f4650 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.648+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 >> 10.20.193.78:0/310270303 conn(0x7fd2880586e0 msgr2=0x7fd288117360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.649+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 shutdown_connections 2026-02-13T02:42:07.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.649+0000 7fd28ff806c0 1 -- 10.20.193.78:0/310270303 wait complete. 2026-02-13T02:42:07.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.651+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcf240b5760 msgr2=0x7fcf240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.651+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcf240b5760 0x7fcf240d5c10 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf48132200 tx=0x7fcf380023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.653 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.651+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 msgr2=0x7fcf4812b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.651+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf4812b870 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf3400b800 tx=0x7fcf3400bcd0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.651+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 shutdown_connections 2026-02-13T02:42:07.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.652+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcf240b5760 0x7fcf240d5c10 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.652+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcf4811b510 0x7fcf48131170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.652+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcf481149c0 0x7fcf4812bdb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.652+0000 7fcf4ea016c0 1 --2- 10.20.193.78:0/499153251 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf48113dc0 0x7fcf4812b870 unknown :-1 s=CLOSED pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.654 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.652+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 >> 10.20.193.78:0/499153251 conn(0x7fcf48058a50 msgr2=0x7fcf48119490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.652+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 shutdown_connections 2026-02-13T02:42:07.659 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.653+0000 7fcf4ea016c0 1 -- 10.20.193.78:0/499153251 wait complete. 2026-02-13T02:42:07.659 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.667 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.732 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.730+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7faeb0005890 con 0x7faeec110d40 2026-02-13T02:42:07.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.734+0000 7faee97fa6c0 1 -- 10.20.193.78:0/2679504562 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faed80ca970 con 0x7faeec110d40 2026-02-13T02:42:07.737 INFO:teuthology.orchestra.run.trial078.stdout:219043332111 2026-02-13T02:42:07.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.738+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faed00b5760 msgr2=0x7faed00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.738+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faed00b5760 0x7faed00d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faedc004750 tx=0x7faedc005910 comp rx=0 tx=0).stop 2026-02-13T02:42:07.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec110d40 msgr2=0x7faeec11ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec110d40 0x7faeec11ab10 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faed802f8a0 tx=0x7faed8002960 comp rx=0 tx=0).stop 2026-02-13T02:42:07.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 shutdown_connections 2026-02-13T02:42:07.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faed00b5760 0x7faed00d5c10 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faeec11fed0 0x7faeec120370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faeec110d40 0x7faeec11ab10 unknown :-1 s=CLOSED pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 --2- 10.20.193.78:0/2679504562 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faeec10ad40 0x7faeec11a5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.739+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 >> 10.20.193.78:0/2679504562 conn(0x7faeec0638a0 msgr2=0x7faeec10eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.740+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 shutdown_connections 2026-02-13T02:42:07.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.740+0000 7faef100b6c0 1 -- 10.20.193.78:0/2679504562 wait complete. 2026-02-13T02:42:07.747 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:07.826 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:07 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1200161304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:42:07.826 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:07 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/499153251' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:42:07.826 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:07 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/310270303' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:42:07.828 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561040 got 188978561039 for osd.7 2026-02-13T02:42:07.888 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051605 got 124554051604 for osd.4 2026-02-13T02:42:07.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 -- 10.20.193.78:0/1905716678 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c115410 msgr2=0x7f4c0c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 --2- 10.20.193.78:0/1905716678 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c115410 0x7f4c0c175db0 secure :-1 s=READY pgs=193 gs=2 cs=0 l=1 c_cookie=1552451094478643603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c0800a9b0 tx=0x7f4c0802fd40 comp rx=0 tx=0).stop 2026-02-13T02:42:07.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 -- 10.20.193.78:0/1905716678 shutdown_connections 2026-02-13T02:42:07.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 --2- 10.20.193.78:0/1905716678 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c115410 0x7f4c0c175db0 unknown :-1 s=CLOSED pgs=193 gs=2 cs=0 l=1 c_cookie=1552451094478643603 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 --2- 10.20.193.78:0/1905716678 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c0c10fbf0 0x7f4c0c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 --2- 10.20.193.78:0/1905716678 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c0c10f200 0x7f4c0c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 -- 10.20.193.78:0/1905716678 >> 10.20.193.78:0/1905716678 conn(0x7f4c0c0ecb00 msgr2=0x7f4c0c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 -- 10.20.193.78:0/1905716678 shutdown_connections 2026-02-13T02:42:07.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.897+0000 7f4c132186c0 1 -- 10.20.193.78:0/1905716678 wait complete. 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.898+0000 7f4c132186c0 1 Processor -- start 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.898+0000 7f4c132186c0 1 -- start start 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.898+0000 7f4c132186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c10f200 0x7f4c0c066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.898+0000 7f4c132186c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c0c115410 0x7f4c0c062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c132186c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c0c062f70 0x7f4c0c063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c132186c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c167af0 con 0x7f4c0c10f200 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c132186c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c167c60 con 0x7f4c0c115410 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c132186c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0c167e20 con 0x7f4c0c062f70 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c10f200 0x7f4c0c066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.902 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c10f200 0x7f4c0c066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34168/0 (socket says 10.20.193.78:34168) 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 -- 10.20.193.78:0/4110635635 learned_addr learned my addr 10.20.193.78:0/4110635635 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c03fff6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c0c115410 0x7f4c0c062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c1178e6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c0c062f70 0x7f4c0c063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 -- 10.20.193.78:0/4110635635 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c0c062f70 msgr2=0x7f4c0c063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c0c062f70 0x7f4c0c063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 -- 10.20.193.78:0/4110635635 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c0c115410 msgr2=0x7f4c0c062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c0c115410 0x7f4c0c062990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 -- 10.20.193.78:0/4110635635 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0800a5b0 con 0x7f4c0c10f200 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c1178e6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c0c062f70 0x7f4c0c063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c10f8d6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c10f200 0x7f4c0c066730 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bfc00b800 tx=0x7f4bfc00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c01ffb6c0 1 -- 10.20.193.78:0/4110635635 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bfc004a80 con 0x7f4c0c10f200 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c01ffb6c0 1 -- 10.20.193.78:0/4110635635 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4bfc009030 con 0x7f4c0c10f200 2026-02-13T02:42:07.903 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c01ffb6c0 1 -- 10.20.193.78:0/4110635635 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4bfc0071c0 con 0x7f4c0c10f200 2026-02-13T02:42:07.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0c168100 con 0x7f4c0c10f200 2026-02-13T02:42:07.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.899+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0c168590 con 0x7f4c0c10f200 2026-02-13T02:42:07.904 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.901+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0c1104d0 con 0x7f4c0c10f200 2026-02-13T02:42:07.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.903+0000 7f4c01ffb6c0 1 -- 10.20.193.78:0/4110635635 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f4bfc00c7a0 con 0x7f4c0c10f200 2026-02-13T02:42:07.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.905+0000 7f4c01ffb6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be80b57e0 0x7f4be80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.905+0000 7f4c01ffb6c0 1 -- 10.20.193.78:0/4110635635 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f4bfc0e3cd0 con 0x7f4c0c10f200 2026-02-13T02:42:07.907 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.905+0000 7f4c01ffb6c0 1 -- 10.20.193.78:0/4110635635 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4bfc0a6620 con 0x7f4c0c10f200 2026-02-13T02:42:07.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.906+0000 7f4c03fff6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be80b57e0 0x7f4be80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.908 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.907+0000 7f4c03fff6c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be80b57e0 0x7f4be80d5c90 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c0c113c50 tx=0x7f4bf4005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:07 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1200161304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:42:07.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:07 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/499153251' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:42:07.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:07 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/310270303' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:42:07.950 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509464 got 64424509463 for osd.2 2026-02-13T02:42:07.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.959+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/8767158 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 msgr2=0x7f1ee8066f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.959+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/8767158 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee8066f00 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=2763751929138167969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ed8009970 tx=0x7f1ed802ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:07.962 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.960+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/8767158 shutdown_connections 2026-02-13T02:42:07.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.960+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/8767158 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1ee8159b20 0x7f1ee8179f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.960+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/8767158 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8067440 0x7f1ee81595e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.960+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/8767158 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee8066f00 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=2763751929138167969 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.963 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.960+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/8767158 >> 10.20.193.78:0/8767158 conn(0x7f1ee8064660 msgr2=0x7f1ee8064a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:07.964 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332111 got 219043332111 for osd.8 2026-02-13T02:42:07.964 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:07.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.961+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/8767158 shutdown_connections 2026-02-13T02:42:07.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.961+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/8767158 wait complete. 2026-02-13T02:42:07.965 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.962+0000 7f1eeeda76c0 1 Processor -- start 2026-02-13T02:42:07.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.962+0000 7f1eeeda76c0 1 -- start start 2026-02-13T02:42:07.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.962+0000 7f1eeeda76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee80f97a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.962+0000 7f1eeeda76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1ee8067440 0x7f1ee80f9ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.962+0000 7f1eeeda76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8159b20 0x7f1ee80ff0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eeeda76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80ff6f0 con 0x7f1ee8159b20 2026-02-13T02:42:07.966 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eeeda76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80ff860 con 0x7f1ee8066b30 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eeeda76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee80ffa20 con 0x7f1ee8067440 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eee5a66c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8159b20 0x7f1ee80ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eee5a66c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8159b20 0x7f1ee80ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34178/0 (socket says 10.20.193.78:34178) 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eedda56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee80f97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eedda56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee80f97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60450/0 (socket says 10.20.193.78:60450) 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eedda56c0 1 -- 10.20.193.78:0/1528348716 learned_addr learned my addr 10.20.193.78:0/1528348716 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.963+0000 7f1eed5a46c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1ee8067440 0x7f1ee80f9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eee5a66c0 1 -- 10.20.193.78:0/1528348716 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1ee8067440 msgr2=0x7f1ee80f9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eee5a66c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1ee8067440 0x7f1ee80f9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eee5a66c0 1 -- 10.20.193.78:0/1528348716 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 msgr2=0x7f1ee80f97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:07.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eee5a66c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee80f97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:07.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eee5a66c0 1 -- 10.20.193.78:0/1528348716 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8009590 con 0x7f1ee8159b20 2026-02-13T02:42:07.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eed5a46c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1ee8067440 0x7f1ee80f9ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:07.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eedda56c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee80f97a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:07.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eee5a66c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8159b20 0x7f1ee80ff0a0 secure :-1 s=READY pgs=195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ee8068d70 tx=0x7f1ee400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:07.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1ed6ffd6c0 1 -- 10.20.193.78:0/1528348716 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ee4005340 con 0x7f1ee8159b20 2026-02-13T02:42:07.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee80ffd00 con 0x7f1ee8159b20 2026-02-13T02:42:07.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee81403e0 con 0x7f1ee8159b20 2026-02-13T02:42:07.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1ed6ffd6c0 1 -- 10.20.193.78:0/1528348716 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1ee4003cf0 con 0x7f1ee8159b20 2026-02-13T02:42:07.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.964+0000 7f1ed6ffd6c0 1 -- 10.20.193.78:0/1528348716 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ee4005340 con 0x7f1ee8159b20 2026-02-13T02:42:07.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.965+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb0005310 con 0x7f1ee8159b20 2026-02-13T02:42:07.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.967+0000 7f1ed6ffd6c0 1 -- 10.20.193.78:0/1528348716 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f1ee4003810 con 0x7f1ee8159b20 2026-02-13T02:42:07.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.969+0000 7f1ed6ffd6c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1ec40b57c0 0x7f1ec40d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:07.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.969+0000 7f1ed6ffd6c0 1 -- 10.20.193.78:0/1528348716 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1ee40e4620 con 0x7f1ee8159b20 2026-02-13T02:42:07.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.970+0000 7f1eedda56c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1ec40b57c0 0x7f1ec40d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:07.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.970+0000 7f1ed6ffd6c0 1 -- 10.20.193.78:0/1528348716 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1ee40a6f70 con 0x7f1ee8159b20 2026-02-13T02:42:07.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:07.970+0000 7f1eedda56c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1ec40b57c0 0x7f1ec40d5c70 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ed80098c0 tx=0x7f1ed8005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:07 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1200161304' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:42:08.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:07 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/499153251' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:42:08.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:07 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/310270303' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:42:08.019 INFO:teuthology.orchestra.run.trial078.stdout:171798691857 2026-02-13T02:42:08.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.016+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4c0c10fbf0 con 0x7f4c0c10f200 2026-02-13T02:42:08.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.017+0000 7f4c01ffb6c0 1 -- 10.20.193.78:0/4110635635 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4bfc0a6620 con 0x7f4c0c10f200 2026-02-13T02:42:08.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.020+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be80b57e0 msgr2=0x7f4be80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.020+0000 7f4c132186c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be80b57e0 0x7f4be80d5c90 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c0c113c50 tx=0x7f4bf4005f10 comp rx=0 tx=0).stop 2026-02-13T02:42:08.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.020+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c10f200 msgr2=0x7f4c0c066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.022 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.020+0000 7f4c132186c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c10f200 0x7f4c0c066730 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4bfc00b800 tx=0x7f4bfc00bcd0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.020+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 shutdown_connections 2026-02-13T02:42:08.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.020+0000 7f4c132186c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4be80b57e0 0x7f4be80d5c90 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.021+0000 7f4c132186c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4c0c062f70 0x7f4c0c063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.021+0000 7f4c132186c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4c0c115410 0x7f4c0c062990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.021+0000 7f4c132186c0 1 --2- 10.20.193.78:0/4110635635 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4c0c10f200 0x7f4c0c066730 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.021+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 >> 10.20.193.78:0/4110635635 conn(0x7f4c0c0ecb00 msgr2=0x7f4c0c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.021+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 shutdown_connections 2026-02-13T02:42:08.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.021+0000 7f4c132186c0 1 -- 10.20.193.78:0/4110635635 wait complete. 2026-02-13T02:42:08.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.090+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1eb00055c0 con 0x7f1ee8159b20 2026-02-13T02:42:08.098 INFO:teuthology.orchestra.run.trial078.stdout:47244640282 2026-02-13T02:42:08.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.091+0000 7f1ed6ffd6c0 1 -- 10.20.193.78:0/1528348716 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ee40aa120 con 0x7f1ee8159b20 2026-02-13T02:42:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1ec40b57c0 msgr2=0x7f1ec40d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1ec40b57c0 0x7f1ec40d5c70 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ed80098c0 tx=0x7f1ed8005ae0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8159b20 msgr2=0x7f1ee80ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8159b20 0x7f1ee80ff0a0 secure :-1 s=READY pgs=195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ee8068d70 tx=0x7f1ee400cb60 comp rx=0 tx=0).stop 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 shutdown_connections 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1ec40b57c0 0x7f1ec40d5c70 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ee8159b20 0x7f1ee80ff0a0 unknown :-1 s=CLOSED pgs=195 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1ee8067440 0x7f1ee80f9ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 --2- 10.20.193.78:0/1528348716 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1ee8066b30 0x7f1ee80f97a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.100+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 >> 10.20.193.78:0/1528348716 conn(0x7f1ee8064660 msgr2=0x7f1ee806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.101+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 shutdown_connections 2026-02-13T02:42:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.101+0000 7f1eeeda76c0 1 -- 10.20.193.78:0/1528348716 wait complete. 2026-02-13T02:42:08.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.113+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3295670341 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410cfb0 msgr2=0x7f699410d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.113+0000 7fbcbb6086c0 1 -- 10.20.193.78:0/1127947796 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb41149f0 msgr2=0x7fbcb4116380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.113+0000 7fbcbb6086c0 1 --2- 10.20.193.78:0/1127947796 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb41149f0 0x7fbcb4116380 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=92951778248216053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca80075a0 tx=0x7fbca802fdc0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.113+0000 7fbcbb6086c0 1 -- 10.20.193.78:0/1127947796 shutdown_connections 2026-02-13T02:42:08.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.113+0000 7fbcbb6086c0 1 --2- 10.20.193.78:0/1127947796 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4116b30 0x7fbcb417a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.113+0000 7fbcbb6086c0 1 --2- 10.20.193.78:0/1127947796 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb41149f0 0x7fbcb4116380 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=92951778248216053 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.113+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3295670341 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410cfb0 0x7f699410d380 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=18200907043767183260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6988009970 tx=0x7f698802ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:08.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3295670341 shutdown_connections 2026-02-13T02:42:08.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3295670341 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69941131c0 0x7f6994173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3295670341 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f699410d9a0 0x7f69941129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3295670341 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410cfb0 0x7f699410d380 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=18200907043767183260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3295670341 >> 10.20.193.78:0/3295670341 conn(0x7f69940ea8b0 msgr2=0x7f699410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3295670341 shutdown_connections 2026-02-13T02:42:08.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3295670341 wait complete. 2026-02-13T02:42:08.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7fbcbb6086c0 1 --2- 10.20.193.78:0/1127947796 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4114000 0x7fbcb41143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7fbcbb6086c0 1 -- 10.20.193.78:0/1127947796 >> 10.20.193.78:0/1127947796 conn(0x7fbcb40586e0 msgr2=0x7fbcb4058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7fbcbb6086c0 1 -- 10.20.193.78:0/1127947796 shutdown_connections 2026-02-13T02:42:08.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7fbcbb6086c0 1 -- 10.20.193.78:0/1127947796 wait complete. 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 Processor -- start 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- start start 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f699410cfb0 0x7f699410a3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69941131c0 0x7f6994173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410aa20 0x7f69940f3ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f69997316c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f699410cfb0 0x7f699410a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f69997316c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f699410cfb0 0x7f699410a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45678/0 (socket says 10.20.193.78:45678) 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f69997316c0 1 -- 10.20.193.78:0/3897849142 learned_addr learned my addr 10.20.193.78:0/3897849142 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f699410b110 con 0x7f69941131c0 2026-02-13T02:42:08.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f6999f326c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410aa20 0x7f69940f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f69940f3ff0 con 0x7f699410aa20 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69940f41b0 con 0x7f699410cfb0 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f6999f326c0 1 -- 10.20.193.78:0/3897849142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f699410cfb0 msgr2=0x7f699410a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f6999f326c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f699410cfb0 0x7f699410a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f6999f326c0 1 -- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69941131c0 msgr2=0x7f6994173a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f6999f326c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69941131c0 0x7f6994173a60 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f6999f326c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699000a5b0 con 0x7f699410aa20 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f6999f326c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410aa20 0x7f69940f3ab0 secure :-1 s=READY pgs=118 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f699000c9b0 tx=0x7f699000cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f69827fc6c0 1 -- 10.20.193.78:0/3897849142 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6990003c40 con 0x7f699410aa20 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f69827fc6c0 1 -- 10.20.193.78:0/3897849142 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f699000a070 con 0x7f699410aa20 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f69827fc6c0 1 -- 10.20.193.78:0/3897849142 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69900081c0 con 0x7f699410aa20 2026-02-13T02:42:08.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6988009590 con 0x7f699410aa20 2026-02-13T02:42:08.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69940f4790 con 0x7f699410aa20 2026-02-13T02:42:08.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.115+0000 7fbcbb6086c0 1 Processor -- start 2026-02-13T02:42:08.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcbb6086c0 1 -- start start 2026-02-13T02:42:08.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcbb6086c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb4114000 0x7fbcb411e690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcbb6086c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4116b30 0x7fbcb411ebd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcbb6086c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4123f90 0x7fbcb4124430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7f69827fc6c0 1 -- 10.20.193.78:0/3897849142 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6990005030 con 0x7f699410aa20 2026-02-13T02:42:08.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcbb6086c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb41249a0 con 0x7fbcb4123f90 2026-02-13T02:42:08.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcbb6086c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb4124b10 con 0x7fbcb4116b30 2026-02-13T02:42:08.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcbb6086c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb4124cd0 con 0x7fbcb4114000 2026-02-13T02:42:08.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcb8b7c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4116b30 0x7fbcb411ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.120+0000 7fbcb937d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb4114000 0x7fbcb411e690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb8b7c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4116b30 0x7fbcb411ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60482/0 (socket says 10.20.193.78:60482) 2026-02-13T02:42:08.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb8b7c6c0 1 -- 10.20.193.78:0/3608761639 learned_addr learned my addr 10.20.193.78:0/3608761639 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:08.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb9b7e6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4123f90 0x7fbcb4124430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7f69827fc6c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f697c0b5830 0x7f697c0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.127 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7f69827fc6c0 1 -- 10.20.193.78:0/3897849142 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f69900e4bc0 con 0x7f699410aa20 2026-02-13T02:42:08.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb937d6c0 1 -- 10.20.193.78:0/3608761639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4116b30 msgr2=0x7fbcb411ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb937d6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4116b30 0x7fbcb411ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb937d6c0 1 -- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4123f90 msgr2=0x7fbcb4124430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb937d6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4123f90 0x7fbcb4124430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.128 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb937d6c0 1 -- 10.20.193.78:0/3608761639 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca80071c0 con 0x7fbcb4114000 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb8b7c6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4116b30 0x7fbcb411ebd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb9b7e6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4123f90 0x7fbcb4124430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcb937d6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb4114000 0x7fbcb411e690 secure :-1 s=READY pgs=108 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca4004750 tx=0x7fbca400bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbca27fc6c0 1 -- 10.20.193.78:0/3608761639 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbca4004a80 con 0x7fbcb4114000 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcbb6086c0 1 -- 10.20.193.78:0/3608761639 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb4165180 con 0x7fbcb4114000 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbcbb6086c0 1 -- 10.20.193.78:0/3608761639 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb4165660 con 0x7fbcb4114000 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbca27fc6c0 1 -- 10.20.193.78:0/3608761639 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbca4009030 con 0x7fbcb4114000 2026-02-13T02:42:08.129 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.123+0000 7fbca27fc6c0 1 -- 10.20.193.78:0/3608761639 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbca4005680 con 0x7fbcb4114000 2026-02-13T02:42:08.130 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6960005310 con 0x7f699410aa20 2026-02-13T02:42:08.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7efc1b8616c0 1 -- 10.20.193.78:0/3026259919 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc14113dc0 msgr2=0x7efc14114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.131 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/3026259919 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc14113dc0 0x7efc14114210 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=1415885330092710945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc080098a0 tx=0x7efc0802ec90 comp rx=0 tx=0).stop 2026-02-13T02:42:08.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7efc1b8616c0 1 -- 10.20.193.78:0/3026259919 shutdown_connections 2026-02-13T02:42:08.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/3026259919 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efc141149c0 0x7efc14114ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/3026259919 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc14113dc0 0x7efc14114210 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=1415885330092710945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/3026259919 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc1411b510 0x7efc1411b8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.132 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.128+0000 7efc1b8616c0 1 -- 10.20.193.78:0/3026259919 >> 10.20.193.78:0/3026259919 conn(0x7efc14058a50 msgr2=0x7efc14058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7f69997316c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f697c0b5830 0x7f697c0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- 10.20.193.78:0/3026259919 shutdown_connections 2026-02-13T02:42:08.133 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb4114fe0 con 0x7fbcb4114000 2026-02-13T02:42:08.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- 10.20.193.78:0/3026259919 wait complete. 2026-02-13T02:42:08.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7f69827fc6c0 1 -- 10.20.193.78:0/3897849142 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69900a7510 con 0x7f699410aa20 2026-02-13T02:42:08.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7f69997316c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f697c0b5830 0x7f697c0d5ce0 secure :-1 s=READY pgs=175 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6988005a00 tx=0x7f6988005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.134 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 Processor -- start 2026-02-13T02:42:08.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- start start 2026-02-13T02:42:08.135 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7fbca27fc6c0 1 -- 10.20.193.78:0/3608761639 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fbca400c7a0 con 0x7fbcb4114000 2026-02-13T02:42:08.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7fbca27fc6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b5760 0x7fbc900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc14113dc0 0x7efc1411c800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efc141149c0 0x7efc1411cd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc1411b510 0x7efc14122100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7efc14122750 con 0x7efc1411b510 2026-02-13T02:42:08.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7efc141228c0 con 0x7efc14113dc0 2026-02-13T02:42:08.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7efc14122a80 con 0x7efc141149c0 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc195d26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc14113dc0 0x7efc1411c800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc195d26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc14113dc0 0x7efc1411c800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60502/0 (socket says 10.20.193.78:60502) 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc195d26c0 1 -- 10.20.193.78:0/737871413 learned_addr learned my addr 10.20.193.78:0/737871413 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc19dd36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc1411b510 0x7efc14122100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc19dd36c0 1 -- 10.20.193.78:0/737871413 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efc141149c0 msgr2=0x7efc1411cd40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc19dd36c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efc141149c0 0x7efc1411cd40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc19dd36c0 1 -- 10.20.193.78:0/737871413 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc14113dc0 msgr2=0x7efc1411c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc19dd36c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc14113dc0 0x7efc1411c800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc19dd36c0 1 -- 10.20.193.78:0/737871413 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc080094c0 con 0x7efc1411b510 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc195d26c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc14113dc0 0x7efc1411c800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc19dd36c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc1411b510 0x7efc14122100 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc10006f60 tx=0x7efc1000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc027fc6c0 1 -- 10.20.193.78:0/737871413 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc10003c40 con 0x7efc1411b510 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc027fc6c0 1 -- 10.20.193.78:0/737871413 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efc10003da0 con 0x7efc1411b510 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc027fc6c0 1 -- 10.20.193.78:0/737871413 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efc1000de30 con 0x7efc1411b510 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc14122d60 con 0x7efc1411b510 2026-02-13T02:42:08.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.130+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc14123420 con 0x7efc1411b510 2026-02-13T02:42:08.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.136+0000 7fbcb8b7c6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b5760 0x7fbc900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.136+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbe8005310 con 0x7efc1411b510 2026-02-13T02:42:08.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fbca27fc6c0 1 -- 10.20.193.78:0/3608761639 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fbca40e3b30 con 0x7fbcb4114000 2026-02-13T02:42:08.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fbcb8b7c6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b5760 0x7fbc900d5c10 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcb4125020 tx=0x7fbca8005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fbca27fc6c0 1 -- 10.20.193.78:0/3608761639 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbca40e71c0 con 0x7fbcb4114000 2026-02-13T02:42:08.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- 10.20.193.78:0/1245335750 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb47c101700 msgr2=0x7fb47c121b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/1245335750 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb47c101700 0x7fb47c121b60 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=11812805981166263009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb480006fd0 tx=0x7fb48002fd20 comp rx=0 tx=0).stop 2026-02-13T02:42:08.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- 10.20.193.78:0/1245335750 shutdown_connections 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/1245335750 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb47c101700 0x7fb47c121b60 unknown :-1 s=CLOSED pgs=120 gs=3 cs=0 l=1 c_cookie=11812805981166263009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/1245335750 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb47c00a240 0x7fb47c00a670 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/1245335750 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00dc10 0x7fb47c009c20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- 10.20.193.78:0/1245335750 >> 10.20.193.78:0/1245335750 conn(0x7fb47c094790 msgr2=0x7fb47c0b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- 10.20.193.78:0/1245335750 shutdown_connections 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- 10.20.193.78:0/1245335750 wait complete. 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 Processor -- start 2026-02-13T02:42:08.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- start start 2026-02-13T02:42:08.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00a240 0x7fb47c10b930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb47c101700 0x7fb47c10be70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.144 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb47c1111e0 0x7fb47c111680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c111bf0 con 0x7fb47c00a240 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c111d60 con 0x7fb47c1111e0 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb47c111f20 con 0x7fb47c101700 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00a240 0x7fb47c10b930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00a240 0x7fb47c10b930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34248/0 (socket says 10.20.193.78:34248) 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 -- 10.20.193.78:0/613457746 learned_addr learned my addr 10.20.193.78:0/613457746 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 -- 10.20.193.78:0/613457746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb47c101700 msgr2=0x7fb47c10be70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb47c101700 0x7fb47c10be70 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 -- 10.20.193.78:0/613457746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb47c1111e0 msgr2=0x7fb47c111680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb47c1111e0 0x7fb47c111680 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.145 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 -- 10.20.193.78:0/613457746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb474009590 con 0x7fb47c00a240 2026-02-13T02:42:08.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb488ae56c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00a240 0x7fb47c10b930 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb474004750 tx=0x7fb47400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb479ffb6c0 1 -- 10.20.193.78:0/613457746 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb474004250 con 0x7fb47c00a240 2026-02-13T02:42:08.146 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efc027fc6c0 1 -- 10.20.193.78:0/737871413 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efc10005030 con 0x7efc1411b510 2026-02-13T02:42:08.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb479ffb6c0 1 -- 10.20.193.78:0/613457746 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb474009070 con 0x7fb47c00a240 2026-02-13T02:42:08.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb479ffb6c0 1 -- 10.20.193.78:0/613457746 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4740071c0 con 0x7fb47c00a240 2026-02-13T02:42:08.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48000a5b0 con 0x7fb47c00a240 2026-02-13T02:42:08.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb47c0ff8c0 con 0x7fb47c00a240 2026-02-13T02:42:08.147 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.144+0000 7efc027fc6c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efbf00b58b0 0x7efbf00d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.144+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44c005310 con 0x7fb47c00a240 2026-02-13T02:42:08.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.144+0000 7efc027fc6c0 1 -- 10.20.193.78:0/737871413 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7efc100e4bd0 con 0x7efc1411b510 2026-02-13T02:42:08.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7efc027fc6c0 1 -- 10.20.193.78:0/737871413 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efc100e81e0 con 0x7efc1411b510 2026-02-13T02:42:08.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7efc195d26c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efbf00b58b0 0x7efbf00d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efcbab8d6c0 1 -- 10.20.193.78:0/1031727796 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 msgr2=0x7efcb411b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efcbab8d6c0 1 --2- 10.20.193.78:0/1031727796 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 0x7efcb411b8e0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=13366813455123297861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca4009970 tx=0x7efca402ed30 comp rx=0 tx=0).stop 2026-02-13T02:42:08.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efcbab8d6c0 1 -- 10.20.193.78:0/1031727796 shutdown_connections 2026-02-13T02:42:08.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efcbab8d6c0 1 --2- 10.20.193.78:0/1031727796 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb41149c0 0x7efcb4114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efcbab8d6c0 1 --2- 10.20.193.78:0/1031727796 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efcb4113dc0 0x7efcb4114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efcbab8d6c0 1 --2- 10.20.193.78:0/1031727796 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 0x7efcb411b8e0 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=13366813455123297861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.138+0000 7efcbab8d6c0 1 -- 10.20.193.78:0/1031727796 >> 10.20.193.78:0/1031727796 conn(0x7efcb4058a50 msgr2=0x7efcb4058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7efcbab8d6c0 1 -- 10.20.193.78:0/1031727796 shutdown_connections 2026-02-13T02:42:08.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/2499566543 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e810cde0 msgr2=0x7fb4e810d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/2499566543 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e810cde0 0x7fb4e810d1b0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=11230917396502844732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d80099a0 tx=0x7fb4d802ed40 comp rx=0 tx=0).stop 2026-02-13T02:42:08.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/2499566543 shutdown_connections 2026-02-13T02:42:08.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/2499566543 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4e8112ff0 0x7fb4e8173990 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/2499566543 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810d7d0 0x7fb4e8112810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/2499566543 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e810cde0 0x7fb4e810d1b0 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=11230917396502844732 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/2499566543 >> 10.20.193.78:0/2499566543 conn(0x7fb4e80ea6a0 msgr2=0x7fb4e810aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/2499566543 shutdown_connections 2026-02-13T02:42:08.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/2499566543 wait complete. 2026-02-13T02:42:08.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7efc195d26c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efbf00b58b0 0x7efbf00d5d60 secure :-1 s=READY pgs=177 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc04005980 tx=0x7efc04009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.146+0000 7efcbab8d6c0 1 -- 10.20.193.78:0/1031727796 wait complete. 2026-02-13T02:42:08.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 Processor -- start 2026-02-13T02:42:08.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 -- start start 2026-02-13T02:42:08.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7efcbab8d6c0 1 Processor -- start 2026-02-13T02:42:08.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810cde0 0x7fb4e80f4920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e8112ff0 0x7fb4e8173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4e80f4f50 0x7fb4e80fa220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e80f5640 con 0x7fb4e8112ff0 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e80fa760 con 0x7fb4e810cde0 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7fb4ef0a36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e80fa920 con 0x7fb4e80f4f50 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7fb4ee0a16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810cde0 0x7fb4e80f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7fb4ee0a16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810cde0 0x7fb4e80f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60544/0 (socket says 10.20.193.78:60544) 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7fb4ee0a16c0 1 -- 10.20.193.78:0/1203084193 learned_addr learned my addr 10.20.193.78:0/1203084193 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7fb4ee0a16c0 1 -- 10.20.193.78:0/1203084193 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4e80f4f50 msgr2=0x7fb4e80fa220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7fb4ee0a16c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4e80f4f50 0x7fb4e80fa220 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7fb4ee0a16c0 1 -- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e8112ff0 msgr2=0x7fb4e8173890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:42:08.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.147+0000 7efcbab8d6c0 1 -- start start 2026-02-13T02:42:08.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcbab8d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb4113dc0 0x7efcb412b840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcbab8d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efcb41149c0 0x7efcb412bd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcbab8d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 0x7efcb4131140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcbab8d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4131790 con 0x7efcb41149c0 2026-02-13T02:42:08.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcbab8d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4131900 con 0x7efcb411b510 2026-02-13T02:42:08.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcbab8d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7efcb4131ac0 con 0x7efcb4113dc0 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcb88fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb4113dc0 0x7efcb412b840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcb88fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb4113dc0 0x7efcb412b840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45776/0 (socket says 10.20.193.78:45776) 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcb88fe6c0 1 -- 10.20.193.78:0/2438847807 learned_addr learned my addr 10.20.193.78:0/2438847807 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcb90ff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 0x7efcb4131140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcabfff6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efcb41149c0 0x7efcb412bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcb88fe6c0 1 -- 10.20.193.78:0/2438847807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 msgr2=0x7efcb4131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcb88fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 0x7efcb4131140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7efcb88fe6c0 1 -- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efcb41149c0 msgr2=0x7efcb412bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.156 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.148+0000 7fb479ffb6c0 1 -- 10.20.193.78:0/613457746 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fb4740028c0 con 0x7fb47c00a240 2026-02-13T02:42:08.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.149+0000 7fb4ed8a06c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e8112ff0 0x7fb4e8173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7fb4ee0a16c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e8112ff0 0x7fb4e8173890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7fb4ee0a16c0 1 -- 10.20.193.78:0/1203084193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d8009590 con 0x7fb4e810cde0 2026-02-13T02:42:08.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7fb4ed8a06c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e8112ff0 0x7fb4e8173890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:42:08.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.149+0000 7efcb88fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efcb41149c0 0x7efcb412bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.149+0000 7efcb88fe6c0 1 -- 10.20.193.78:0/2438847807 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca4009590 con 0x7efcb4113dc0 2026-02-13T02:42:08.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7efcb88fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb4113dc0 0x7efcb412b840 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca4005980 tx=0x7efca402fd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7fb4ee0a16c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810cde0 0x7fb4e80f4920 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d802fc50 tx=0x7fb4d802fc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7efca9ffb6c0 1 -- 10.20.193.78:0/2438847807 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca4002ae0 con 0x7efcb4113dc0 2026-02-13T02:42:08.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7efca9ffb6c0 1 -- 10.20.193.78:0/2438847807 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efca4002c40 con 0x7efcb4113dc0 2026-02-13T02:42:08.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7efca9ffb6c0 1 -- 10.20.193.78:0/2438847807 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efca4037360 con 0x7efcb4113dc0 2026-02-13T02:42:08.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7efcbab8d6c0 1 -- 10.20.193.78:0/2438847807 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb4131d40 con 0x7efcb4113dc0 2026-02-13T02:42:08.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7efcbab8d6c0 1 -- 10.20.193.78:0/2438847807 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb4131fc0 con 0x7efcb4113dc0 2026-02-13T02:42:08.159 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7fb479ffb6c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4600b58b0 0x7fb4600d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.150+0000 7fb479ffb6c0 1 -- 10.20.193.78:0/613457746 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb4740e3e70 con 0x7fb47c00a240 2026-02-13T02:42:08.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7fb47bfff6c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4600b58b0 0x7fb4600d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc74005310 con 0x7efcb4113dc0 2026-02-13T02:42:08.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7fb47bfff6c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4600b58b0 0x7fb4600d5d60 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb47c112270 tx=0x7fb46c005c60 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7fb479ffb6c0 1 -- 10.20.193.78:0/613457746 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb4740a67c0 con 0x7fb47c00a240 2026-02-13T02:42:08.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7fb4cf7fe6c0 1 -- 10.20.193.78:0/1203084193 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4d8002ae0 con 0x7fb4e810cde0 2026-02-13T02:42:08.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7fb4cf7fe6c0 1 -- 10.20.193.78:0/1203084193 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb4d8002c40 con 0x7fb4e810cde0 2026-02-13T02:42:08.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7fb4cf7fe6c0 1 -- 10.20.193.78:0/1203084193 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4d80372d0 con 0x7fb4e810cde0 2026-02-13T02:42:08.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.151+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e80faba0 con 0x7fb4e810cde0 2026-02-13T02:42:08.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.152+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e80faf40 con 0x7fb4e810cde0 2026-02-13T02:42:08.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.154+0000 7efca9ffb6c0 1 -- 10.20.193.78:0/2438847807 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efca4007960 con 0x7efcb4113dc0 2026-02-13T02:42:08.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.156+0000 7efca9ffb6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efc840b5760 0x7efc840d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.156+0000 7efca9ffb6c0 1 -- 10.20.193.78:0/2438847807 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7efca4107df0 con 0x7efcb4113dc0 2026-02-13T02:42:08.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.156+0000 7efca9ffb6c0 1 -- 10.20.193.78:0/2438847807 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efca4108270 con 0x7efcb4113dc0 2026-02-13T02:42:08.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.158+0000 7efcabfff6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efc840b5760 0x7efc840d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.156+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e810e0b0 con 0x7fb4e810cde0 2026-02-13T02:42:08.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.160+0000 7efcabfff6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efc840b5760 0x7efc840d5c10 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcb41321d0 tx=0x7efc9c009190 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.161+0000 7fb4cf7fe6c0 1 -- 10.20.193.78:0/1203084193 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fb4d8007940 con 0x7fb4e810cde0 2026-02-13T02:42:08.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.162+0000 7fb4cf7fe6c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4c40b57e0 0x7fb4c40d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:08.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.162+0000 7fb4cf7fe6c0 1 -- 10.20.193.78:0/1203084193 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb4d8107d30 con 0x7fb4e810cde0 2026-02-13T02:42:08.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.162+0000 7fb4cf7fe6c0 1 -- 10.20.193.78:0/1203084193 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb4d8108130 con 0x7fb4e810cde0 2026-02-13T02:42:08.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.163+0000 7fb4ed8a06c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4c40b57e0 0x7fb4c40d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:08.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.164+0000 7fb4ed8a06c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4c40b57e0 0x7fb4c40d5c90 secure :-1 s=READY pgs=180 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e80fb2b0 tx=0x7fb4dc009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:08.197 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691857 got 171798691857 for osd.6 2026-02-13T02:42:08.197 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.254 INFO:tasks.cephadm.ceph_manager.ceph:need seq 47244640282 got 47244640282 for osd.1 2026-02-13T02:42:08.254 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.263+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f69600055c0 con 0x7f699410aa20 2026-02-13T02:42:08.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.264+0000 7f69827fc6c0 1 -- 10.20.193.78:0/3897849142 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6990005310 con 0x7f699410aa20 2026-02-13T02:42:08.266 INFO:teuthology.orchestra.run.trial078.stdout:141733920788 2026-02-13T02:42:08.267 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f697c0b5830 msgr2=0x7f697c0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f697c0b5830 0x7f697c0d5ce0 secure :-1 s=READY pgs=175 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6988005a00 tx=0x7f6988005910 comp rx=0 tx=0).stop 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410aa20 msgr2=0x7f69940f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410aa20 0x7f69940f3ab0 secure :-1 s=READY pgs=118 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f699000c9b0 tx=0x7f699000cdb0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 shutdown_connections 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f697c0b5830 0x7f697c0d5ce0 unknown :-1 s=CLOSED pgs=175 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f699410aa20 0x7f69940f3ab0 unknown :-1 s=CLOSED pgs=118 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69941131c0 0x7f6994173a60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 --2- 10.20.193.78:0/3897849142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f699410cfb0 0x7f699410a3f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.268 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.266+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 >> 10.20.193.78:0/3897849142 conn(0x7f69940ea8b0 msgr2=0x7f69940605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.267+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 shutdown_connections 2026-02-13T02:42:08.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.267+0000 7f699b9c06c0 1 -- 10.20.193.78:0/3897849142 wait complete. 2026-02-13T02:42:08.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.267+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbcb411f7e0 con 0x7fbcb4114000 2026-02-13T02:42:08.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.268+0000 7fbca27fc6c0 1 -- 10.20.193.78:0/3608761639 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbca40a6480 con 0x7fbcb4114000 2026-02-13T02:42:08.270 INFO:teuthology.orchestra.run.trial078.stdout:94489280536 2026-02-13T02:42:08.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b5760 msgr2=0x7fbc900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.273 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b5760 0x7fbc900d5c10 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcb4125020 tx=0x7fbca8005910 comp rx=0 tx=0).stop 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb4114000 msgr2=0x7fbcb411e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb4114000 0x7fbcb411e690 secure :-1 s=READY pgs=108 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca4004750 tx=0x7fbca400bbf0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 shutdown_connections 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b5760 0x7fbc900d5c10 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4123f90 0x7fbcb4124430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4116b30 0x7fbcb411ebd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 --2- 10.20.193.78:0/3608761639 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb4114000 0x7fbcb411e690 unknown :-1 s=CLOSED pgs=108 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.271+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 >> 10.20.193.78:0/3608761639 conn(0x7fbcb40586e0 msgr2=0x7fbcb4115370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.272+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 shutdown_connections 2026-02-13T02:42:08.274 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.272+0000 7fbc83fff6c0 1 -- 10.20.193.78:0/3608761639 wait complete. 2026-02-13T02:42:08.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.272+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7efbe80055c0 con 0x7efc1411b510 2026-02-13T02:42:08.275 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.273+0000 7efc027fc6c0 1 -- 10.20.193.78:0/737871413 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efc100a7520 con 0x7efc1411b510 2026-02-13T02:42:08.277 INFO:teuthology.orchestra.run.trial078.stdout:249108103181 2026-02-13T02:42:08.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efbf00b58b0 msgr2=0x7efbf00d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fb4e810d7d0 con 0x7fb4e810cde0 2026-02-13T02:42:08.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efbf00b58b0 0x7efbf00d5d60 secure :-1 s=READY pgs=177 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc04005980 tx=0x7efc04009390 comp rx=0 tx=0).stop 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc1411b510 msgr2=0x7efc14122100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc1411b510 0x7efc14122100 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efc10006f60 tx=0x7efc1000cc00 comp rx=0 tx=0).stop 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 shutdown_connections 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efbf00b58b0 0x7efbf00d5d60 unknown :-1 s=CLOSED pgs=177 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efc1411b510 0x7efc14122100 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efc141149c0 0x7efc1411cd40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 --2- 10.20.193.78:0/737871413 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efc14113dc0 0x7efc1411c800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 >> 10.20.193.78:0/737871413 conn(0x7efc14058a50 msgr2=0x7efc141172f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 shutdown_connections 2026-02-13T02:42:08.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.277+0000 7efc1b8616c0 1 -- 10.20.193.78:0/737871413 wait complete. 2026-02-13T02:42:08.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.278+0000 7fb4cf7fe6c0 1 -- 10.20.193.78:0/1203084193 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fb4d80ca680 con 0x7fb4e810cde0 2026-02-13T02:42:08.281 INFO:teuthology.orchestra.run.trial078.stdout:300647710730 2026-02-13T02:42:08.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb44c0055c0 con 0x7fb47c00a240 2026-02-13T02:42:08.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4c40b57e0 msgr2=0x7fb4c40d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.281+0000 7fb479ffb6c0 1 -- 10.20.193.78:0/613457746 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4740a9970 con 0x7fb47c00a240 2026-02-13T02:42:08.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4c40b57e0 0x7fb4c40d5c90 secure :-1 s=READY pgs=180 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4e80fb2b0 tx=0x7fb4dc009260 comp rx=0 tx=0).stop 2026-02-13T02:42:08.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810cde0 msgr2=0x7fb4e80f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810cde0 0x7fb4e80f4920 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d802fc50 tx=0x7fb4d802fc80 comp rx=0 tx=0).stop 2026-02-13T02:42:08.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 shutdown_connections 2026-02-13T02:42:08.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4c40b57e0 0x7fb4c40d5c90 unknown :-1 s=CLOSED pgs=180 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4e80f4f50 0x7fb4e80fa220 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4e8112ff0 0x7fb4e8173890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.280+0000 7fb4ef0a36c0 1 --2- 10.20.193.78:0/1203084193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4e810cde0 0x7fb4e80f4920 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.281+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 >> 10.20.193.78:0/1203084193 conn(0x7fb4e80ea6a0 msgr2=0x7fb4e810f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.281+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 shutdown_connections 2026-02-13T02:42:08.284 INFO:teuthology.orchestra.run.trial078.stdout:34359738397 2026-02-13T02:42:08.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.281+0000 7fb4ef0a36c0 1 -- 10.20.193.78:0/1203084193 wait complete. 2026-02-13T02:42:08.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4600b58b0 msgr2=0x7fb4600d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4600b58b0 0x7fb4600d5d60 secure :-1 s=READY pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb47c112270 tx=0x7fb46c005c60 comp rx=0 tx=0).stop 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00a240 msgr2=0x7fb47c10b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00a240 0x7fb47c10b930 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb474004750 tx=0x7fb47400be00 comp rx=0 tx=0).stop 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 shutdown_connections 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb4600b58b0 0x7fb4600d5d60 unknown :-1 s=CLOSED pgs=178 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb47c1111e0 0x7fb47c111680 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb47c101700 0x7fb47c10be70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 --2- 10.20.193.78:0/613457746 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb47c00a240 0x7fb47c10b930 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 >> 10.20.193.78:0/613457746 conn(0x7fb47c094790 msgr2=0x7fb47c0b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.283+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 shutdown_connections 2026-02-13T02:42:08.286 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.284+0000 7fb48ad706c0 1 -- 10.20.193.78:0/613457746 wait complete. 2026-02-13T02:42:08.297 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.295+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7efc74005890 con 0x7efcb4113dc0 2026-02-13T02:42:08.298 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.297+0000 7efca9ffb6c0 1 -- 10.20.193.78:0/2438847807 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7efca40ca740 con 0x7efcb4113dc0 2026-02-13T02:42:08.300 INFO:teuthology.orchestra.run.trial078.stdout:270582939659 2026-02-13T02:42:08.303 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efc840b5760 msgr2=0x7efc840d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efc840b5760 0x7efc840d5c10 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcb41321d0 tx=0x7efc9c009190 comp rx=0 tx=0).stop 2026-02-13T02:42:08.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb4113dc0 msgr2=0x7efcb412b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:08.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb4113dc0 0x7efcb412b840 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efca4005980 tx=0x7efca402fd10 comp rx=0 tx=0).stop 2026-02-13T02:42:08.304 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 shutdown_connections 2026-02-13T02:42:08.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7efc840b5760 0x7efc840d5c10 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efcb411b510 0x7efcb4131140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efcb41149c0 0x7efcb412bd80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 --2- 10.20.193.78:0/2438847807 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efcb4113dc0 0x7efcb412b840 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:08.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 >> 10.20.193.78:0/2438847807 conn(0x7efcb4058a50 msgr2=0x7efcb411a970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:08.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 shutdown_connections 2026-02-13T02:42:08.305 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:08.301+0000 7efc9b7fe6c0 1 -- 10.20.193.78:0/2438847807 wait complete. 2026-02-13T02:42:08.467 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920787 got 141733920788 for osd.5 2026-02-13T02:42:08.467 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.601 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280535 got 94489280536 for osd.3 2026-02-13T02:42:08.602 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.602 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103181 got 249108103181 for osd.9 2026-02-13T02:42:08.603 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.611 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710730 got 300647710730 for osd.11 2026-02-13T02:42:08.611 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.615 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738397 got 34359738397 for osd.0 2026-02-13T02:42:08.615 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.619 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939658 got 270582939659 for osd.10 2026-02-13T02:42:08.619 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:08.829 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: pgmap v186: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2679504562' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4110635635' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1528348716' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3897849142' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3608761639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/737871413' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T02:42:08.879 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1203084193' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T02:42:08.880 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/613457746' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T02:42:08.880 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2438847807' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T02:42:08.889 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T02:42:08.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: pgmap v186: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T02:42:08.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2679504562' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T02:42:08.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4110635635' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T02:42:08.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1528348716' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T02:42:08.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3897849142' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T02:42:08.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3608761639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T02:42:08.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/737871413' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T02:42:08.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1203084193' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T02:42:08.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/613457746' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T02:42:08.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2438847807' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T02:42:08.951 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T02:42:09.013 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: pgmap v186: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2679504562' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4110635635' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1528348716' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3897849142' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3608761639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/737871413' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1203084193' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/613457746' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T02:42:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2438847807' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T02:42:09.072 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:09.138 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:09.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.219+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/3620601318 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 msgr2=0x7fa4e4113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.219+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/3620601318 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4113b70 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=7261166802733926899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4d4009970 tx=0x7fa4d402ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.219+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/3620601318 shutdown_connections 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.219+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/3620601318 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4e41198f0 0x7fa4e417a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.219+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/3620601318 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4e4114190 0x7fa4e4119140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.219+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/3620601318 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4113b70 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=7261166802733926899 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.219+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/3620601318 >> 10.20.193.78:0/3620601318 conn(0x7fa4e4060760 msgr2=0x7fa4e4060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.220+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/3620601318 shutdown_connections 2026-02-13T02:42:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.220+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/3620601318 wait complete. 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 Processor -- start 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 -- start start 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4121680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4e41198f0 0x7fa4e4121bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4e4126f80 0x7fa4e4127420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e4127990 con 0x7fa4e41198f0 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e4127b00 con 0x7fa4e4126f80 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4ebcbc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e4127cc0 con 0x7fa4e41137a0 2026-02-13T02:42:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4e9a2d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4121680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4e9a2d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4121680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45792/0 (socket says 10.20.193.78:45792) 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.221+0000 7fa4e9a2d6c0 1 -- 10.20.193.78:0/2443653220 learned_addr learned my addr 10.20.193.78:0/2443653220 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4e9a2d6c0 1 -- 10.20.193.78:0/2443653220 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4e4126f80 msgr2=0x7fa4e4127420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4e9a2d6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4e4126f80 0x7fa4e4127420 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4e9a2d6c0 1 -- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4e41198f0 msgr2=0x7fa4e4121bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4e9a2d6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4e41198f0 0x7fa4e4121bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4e9a2d6c0 1 -- 10.20.193.78:0/2443653220 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d4009590 con 0x7fa4e41137a0 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4e9a2d6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4121680 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4d4031fd0 tx=0x7fa4d402fc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:09.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4d2ffd6c0 1 -- 10.20.193.78:0/2443653220 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4d4002ae0 con 0x7fa4e41137a0 2026-02-13T02:42:09.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4d2ffd6c0 1 -- 10.20.193.78:0/2443653220 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa4d40046b0 con 0x7fa4e41137a0 2026-02-13T02:42:09.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4d2ffd6c0 1 -- 10.20.193.78:0/2443653220 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4d4031030 con 0x7fa4e41137a0 2026-02-13T02:42:09.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e4168110 con 0x7fa4e41137a0 2026-02-13T02:42:09.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.222+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e4168590 con 0x7fa4e41137a0 2026-02-13T02:42:09.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.223+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e41149e0 con 0x7fa4e41137a0 2026-02-13T02:42:09.227 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.224+0000 7fa4d2ffd6c0 1 -- 10.20.193.78:0/2443653220 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa4d4002c40 con 0x7fa4e41137a0 2026-02-13T02:42:09.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.226+0000 7fa4d2ffd6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4c00b5760 0x7fa4c00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.226+0000 7fa4d2ffd6c0 1 -- 10.20.193.78:0/2443653220 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa4d4107e70 con 0x7fa4e41137a0 2026-02-13T02:42:09.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.226+0000 7fa4d2ffd6c0 1 -- 10.20.193.78:0/2443653220 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4d41082f0 con 0x7fa4e41137a0 2026-02-13T02:42:09.228 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.226+0000 7fa4e922c6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4c00b5760 0x7fa4c00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.229 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.227+0000 7fa4e922c6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4c00b5760 0x7fa4c00d5c10 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4e4128010 tx=0x7fa4d80096a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:09.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c1d746c0 1 -- 10.20.193.78:0/151824021 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22b802fdd0 con 0x7f22c411b510 2026-02-13T02:42:09.277 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c91156c0 1 -- 10.20.193.78:0/151824021 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22c411b510 msgr2=0x7f22c411b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c91156c0 1 --2- 10.20.193.78:0/151824021 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22c411b510 0x7f22c411b8e0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=16539310533700899029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22b8009970 tx=0x7f22b802ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c91156c0 1 -- 10.20.193.78:0/151824021 shutdown_connections 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c91156c0 1 --2- 10.20.193.78:0/151824021 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c41149c0 0x7f22c4114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c91156c0 1 --2- 10.20.193.78:0/151824021 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22c4113dc0 0x7f22c4114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c91156c0 1 --2- 10.20.193.78:0/151824021 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22c411b510 0x7f22c411b8e0 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=16539310533700899029 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.275+0000 7f22c91156c0 1 -- 10.20.193.78:0/151824021 >> 10.20.193.78:0/151824021 conn(0x7f22c4058a50 msgr2=0x7f22c4058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.276+0000 7f22c91156c0 1 -- 10.20.193.78:0/151824021 shutdown_connections 2026-02-13T02:42:09.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.276+0000 7f22c91156c0 1 -- 10.20.193.78:0/151824021 wait complete. 2026-02-13T02:42:09.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.276+0000 7f22c91156c0 1 Processor -- start 2026-02-13T02:42:09.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.276+0000 7f22c91156c0 1 -- start start 2026-02-13T02:42:09.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c91156c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c4113dc0 0x7f22c412b7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c91156c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22c41149c0 0x7f22c412bd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c91156c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22c411b510 0x7f22c41310f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c91156c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4131740 con 0x7f22c4113dc0 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c91156c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f22c41318b0 con 0x7f22c411b510 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c91156c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4131a70 con 0x7f22c41149c0 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c2d766c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c4113dc0 0x7f22c412b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c2d766c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c4113dc0 0x7f22c412b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34298/0 (socket says 10.20.193.78:34298) 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c2d766c0 1 -- 10.20.193.78:0/1520869250 learned_addr learned my addr 10.20.193.78:0/1520869250 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c25756c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22c41149c0 0x7f22c412bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c25756c0 1 -- 10.20.193.78:0/1520869250 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22c411b510 msgr2=0x7f22c41310f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c25756c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22c411b510 0x7f22c41310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c25756c0 1 -- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c4113dc0 msgr2=0x7f22c412b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c25756c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c4113dc0 0x7f22c412b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.281 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c25756c0 1 -- 10.20.193.78:0/1520869250 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b8009590 con 0x7f22c41149c0 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.277+0000 7f22c2d766c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c4113dc0 0x7f22c412b7f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.278+0000 7f22c25756c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22c41149c0 0x7f22c412bd30 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ac00b6c0 tx=0x7f22ac00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.278+0000 7f229bfff6c0 1 -- 10.20.193.78:0/1520869250 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22ac004240 con 0x7f22c41149c0 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.278+0000 7f229bfff6c0 1 -- 10.20.193.78:0/1520869250 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f22ac009030 con 0x7f22c41149c0 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.278+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c4131d50 con 0x7f22c41149c0 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.278+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c4172430 con 0x7f22c41149c0 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.278+0000 7f229bfff6c0 1 -- 10.20.193.78:0/1520869250 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22ac0036e0 con 0x7f22c41149c0 2026-02-13T02:42:09.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.278+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c4131f70 con 0x7f22c41149c0 2026-02-13T02:42:09.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.280+0000 7f229bfff6c0 1 -- 10.20.193.78:0/1520869250 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f22ac0038c0 con 0x7f22c41149c0 2026-02-13T02:42:09.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.282+0000 7f229bfff6c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22940b56e0 0x7f22940d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.283 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.282+0000 7f229bfff6c0 1 -- 10.20.193.78:0/1520869250 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f22ac0e3b50 con 0x7f22c41149c0 2026-02-13T02:42:09.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.282+0000 7f229bfff6c0 1 -- 10.20.193.78:0/1520869250 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f22ac11c5e0 con 0x7f22c41149c0 2026-02-13T02:42:09.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.282+0000 7f22c2d766c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22940b56e0 0x7f22940d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.282+0000 7f22c2d766c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22940b56e0 0x7f22940d5b90 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22b8031fd0 tx=0x7f22b8005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:09.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.329+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa4e4122830 con 0x7fa4e41137a0 2026-02-13T02:42:09.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.329+0000 7fa4d2ffd6c0 1 -- 10.20.193.78:0/2443653220 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa4d40ca7c0 con 0x7fa4e41137a0 2026-02-13T02:42:09.331 INFO:teuthology.orchestra.run.trial078.stdout:188978561040 2026-02-13T02:42:09.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.331+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4c00b5760 msgr2=0x7fa4c00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.331+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4c00b5760 0x7fa4c00d5c10 secure :-1 s=READY pgs=181 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4e4128010 tx=0x7fa4d80096a0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.331+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 msgr2=0x7fa4e4121680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.331+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4121680 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4d4031fd0 tx=0x7fa4d402fc70 comp rx=0 tx=0).stop 2026-02-13T02:42:09.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 shutdown_connections 2026-02-13T02:42:09.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4c00b5760 0x7fa4c00d5c10 unknown :-1 s=CLOSED pgs=181 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4e4126f80 0x7fa4e4127420 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4e41198f0 0x7fa4e4121bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 --2- 10.20.193.78:0/2443653220 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4e41137a0 0x7fa4e4121680 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 >> 10.20.193.78:0/2443653220 conn(0x7fa4e4060760 msgr2=0x7fa4e41158a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:09.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 shutdown_connections 2026-02-13T02:42:09.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.332+0000 7fa4ebcbc6c0 1 -- 10.20.193.78:0/2443653220 wait complete. 2026-02-13T02:42:09.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.343+0000 7f93d11606c0 1 -- 10.20.193.78:0/4263417236 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc10fbf0 msgr2=0x7f93cc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.343+0000 7f93d11606c0 1 --2- 10.20.193.78:0/4263417236 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc10fbf0 0x7f93cc114c30 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=10793459072927323132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93b4009970 tx=0x7f93b402ed30 comp rx=0 tx=0).stop 2026-02-13T02:42:09.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 -- 10.20.193.78:0/4263417236 shutdown_connections 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 --2- 10.20.193.78:0/4263417236 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93cc115410 0x7f93cc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 --2- 10.20.193.78:0/4263417236 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc10fbf0 0x7f93cc114c30 unknown :-1 s=CLOSED pgs=123 gs=2 cs=0 l=1 c_cookie=10793459072927323132 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 --2- 10.20.193.78:0/4263417236 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93cc10f200 0x7f93cc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 -- 10.20.193.78:0/4263417236 >> 10.20.193.78:0/4263417236 conn(0x7f93cc0ecb00 msgr2=0x7f93cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 -- 10.20.193.78:0/4263417236 shutdown_connections 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 -- 10.20.193.78:0/4263417236 wait complete. 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 Processor -- start 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.344+0000 7f93d11606c0 1 -- start start 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93d11606c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93cc10f200 0x7f93cc0f4b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93d11606c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93cc115410 0x7f93cc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93d11606c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc0f51a0 0x7f93cc0fa470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93d11606c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0f5890 con 0x7f93cc10f200 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93ca5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93cc115410 0x7f93cc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93cad766c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93cc10f200 0x7f93cc0f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93ca5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93cc115410 0x7f93cc175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45812/0 (socket says 10.20.193.78:45812) 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93ca5756c0 1 -- 10.20.193.78:0/2035770421 learned_addr learned my addr 10.20.193.78:0/2035770421 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93cb5776c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc0f51a0 0x7f93cc0fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0fa9b0 con 0x7f93cc0f51a0 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc0fab70 con 0x7f93cc115410 2026-02-13T02:42:09.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93cb5776c0 1 -- 10.20.193.78:0/2035770421 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93cc115410 msgr2=0x7f93cc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93cb5776c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93cc115410 0x7f93cc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93cb5776c0 1 -- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93cc10f200 msgr2=0x7f93cc0f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93cb5776c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93cc10f200 0x7f93cc0f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.345+0000 7f93cb5776c0 1 -- 10.20.193.78:0/2035770421 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b4009590 con 0x7f93cc0f51a0 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.346+0000 7f93cb5776c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc0f51a0 0x7f93cc0fa470 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93bc00c6f0 tx=0x7f93bc00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.346+0000 7f93abfff6c0 1 -- 10.20.193.78:0/2035770421 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93bc005340 con 0x7f93cc0f51a0 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.346+0000 7f93abfff6c0 1 -- 10.20.193.78:0/2035770421 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f93bc003cf0 con 0x7f93cc0f51a0 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.346+0000 7f93abfff6c0 1 -- 10.20.193.78:0/2035770421 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f93bc00dd60 con 0x7f93cc0f51a0 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.346+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc0fae50 con 0x7f93cc0f51a0 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.346+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc0fb2e0 con 0x7f93cc0f51a0 2026-02-13T02:42:09.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.346+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93cc1104d0 con 0x7f93cc0f51a0 2026-02-13T02:42:09.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.348+0000 7f93abfff6c0 1 -- 10.20.193.78:0/2035770421 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f93bc003810 con 0x7f93cc0f51a0 2026-02-13T02:42:09.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.350+0000 7f93abfff6c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f939c0b5760 0x7f939c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.350+0000 7f93abfff6c0 1 -- 10.20.193.78:0/2035770421 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f93bc0e4840 con 0x7f93cc0f51a0 2026-02-13T02:42:09.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.350+0000 7f93abfff6c0 1 -- 10.20.193.78:0/2035770421 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f93bc0e4cc0 con 0x7f93cc0f51a0 2026-02-13T02:42:09.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.350+0000 7f93cad766c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f939c0b5760 0x7f939c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.351+0000 7f93cad766c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f939c0b5760 0x7f939c0d5c10 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c0004750 tx=0x7f93c0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:09.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.385+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f22c412c940 con 0x7f22c41149c0 2026-02-13T02:42:09.386 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.385+0000 7f229bfff6c0 1 -- 10.20.193.78:0/1520869250 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f22ac0a64a0 con 0x7f22c41149c0 2026-02-13T02:42:09.388 INFO:teuthology.orchestra.run.trial078.stdout:124554051605 2026-02-13T02:42:09.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.387+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22940b56e0 msgr2=0x7f22940d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.387+0000 7f22c91156c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22940b56e0 0x7f22940d5b90 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22b8031fd0 tx=0x7f22b8005ae0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.387+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22c41149c0 msgr2=0x7f22c412bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.387+0000 7f22c91156c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22c41149c0 0x7f22c412bd30 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ac00b6c0 tx=0x7f22ac00bb90 comp rx=0 tx=0).stop 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 shutdown_connections 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f22940b56e0 0x7f22940d5b90 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f22c411b510 0x7f22c41310f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f22c41149c0 0x7f22c412bd30 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 --2- 10.20.193.78:0/1520869250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f22c4113dc0 0x7f22c412b7f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 >> 10.20.193.78:0/1520869250 conn(0x7f22c4058a50 msgr2=0x7f22c411a580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 shutdown_connections 2026-02-13T02:42:09.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.388+0000 7f22c91156c0 1 -- 10.20.193.78:0/1520869250 wait complete. 2026-02-13T02:42:09.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.454+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f93cc0fb2e0 con 0x7f93cc0f51a0 2026-02-13T02:42:09.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.454+0000 7f93abfff6c0 1 -- 10.20.193.78:0/2035770421 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93bc0a7190 con 0x7f93cc0f51a0 2026-02-13T02:42:09.458 INFO:teuthology.orchestra.run.trial078.stdout:64424509465 2026-02-13T02:42:09.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f939c0b5760 msgr2=0x7f939c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f939c0b5760 0x7f939c0d5c10 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93c0004750 tx=0x7f93c0009260 comp rx=0 tx=0).stop 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc0f51a0 msgr2=0x7f93cc0fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc0f51a0 0x7f93cc0fa470 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f93bc00c6f0 tx=0x7f93bc00cbc0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 shutdown_connections 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f939c0b5760 0x7f939c0d5c10 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f93cc0f51a0 0x7f93cc0fa470 unknown :-1 s=CLOSED pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f93cc115410 0x7f93cc175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 --2- 10.20.193.78:0/2035770421 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f93cc10f200 0x7f93cc0f4b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 >> 10.20.193.78:0/2035770421 conn(0x7f93cc0ecb00 msgr2=0x7f93cc113bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:09.459 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 shutdown_connections 2026-02-13T02:42:09.460 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.456+0000 7f93d11606c0 1 -- 10.20.193.78:0/2035770421 wait complete. 2026-02-13T02:42:09.526 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561040 got 188978561040 for osd.7 2026-02-13T02:42:09.526 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:09.536 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051605 got 124554051605 for osd.4 2026-02-13T02:42:09.536 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:09.591 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509464 got 64424509465 for osd.2 2026-02-13T02:42:09.591 DEBUG:teuthology.parallel:result is None 2026-02-13T02:42:09.591 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T02:42:09.591 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:42:09.774 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:09.904 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:09 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2443653220' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:42:09.904 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:09 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1520869250' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:42:09.904 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:09 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2035770421' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:42:09.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:09 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2443653220' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:42:09.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:09 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1520869250' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:42:09.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:09 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2035770421' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:42:09.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/2091771983 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc10f200 msgr2=0x7f8fdc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/2091771983 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc10f200 0x7f8fdc10f5d0 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=18053638076992813678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc80099a0 tx=0x7f8fc802ed00 comp rx=0 tx=0).stop 2026-02-13T02:42:09.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/2091771983 shutdown_connections 2026-02-13T02:42:09.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/2091771983 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 0x7f8fdc175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/2091771983 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8fdc10fbf0 0x7f8fdc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/2091771983 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc10f200 0x7f8fdc10f5d0 unknown :-1 s=CLOSED pgs=200 gs=1 cs=0 l=1 c_cookie=18053638076992813678 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/2091771983 >> 10.20.193.78:0/2091771983 conn(0x7f8fdc0ecb00 msgr2=0x7f8fdc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:09.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.966+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/2091771983 shutdown_connections 2026-02-13T02:42:09.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.967+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/2091771983 wait complete. 2026-02-13T02:42:09.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.967+0000 7f8fe1b786c0 1 Processor -- start 2026-02-13T02:42:09.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.967+0000 7f8fe1b786c0 1 -- start start 2026-02-13T02:42:09.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fe1b786c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8fdc10f200 0x7f8fdc11d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fe1b786c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 0x7f8fdc11d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fe1b786c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc122ae0 0x7f8fdc122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fe1b786c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1234f0 con 0x7f8fdc122ae0 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fe1b786c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc123660 con 0x7f8fdc10f200 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fe1b786c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc123820 con 0x7f8fdc115410 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdb7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8fdc10f200 0x7f8fdc11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 0x7f8fdc11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 0x7f8fdc11d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45834/0 (socket says 10.20.193.78:45834) 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 -- 10.20.193.78:0/3424772687 learned_addr learned my addr 10.20.193.78:0/3424772687 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdbfff6c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc122ae0 0x7f8fdc122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 -- 10.20.193.78:0/3424772687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8fdc10f200 msgr2=0x7f8fdc11d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8fdc10f200 0x7f8fdc11d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 -- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc122ae0 msgr2=0x7f8fdc122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc122ae0 0x7f8fdc122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 -- 10.20.193.78:0/3424772687 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc8009590 con 0x7f8fdc115410 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdb7fe6c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8fdc10f200 0x7f8fdc11d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.968+0000 7f8fdaffd6c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 0x7f8fdc11d720 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc00b800 tx=0x7f8fcc00bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.969+0000 7f8fd8ff96c0 1 -- 10.20.193.78:0/3424772687 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc004a80 con 0x7f8fdc115410 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.969+0000 7f8fd8ff96c0 1 -- 10.20.193.78:0/3424772687 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8fcc009070 con 0x7f8fdc115410 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.969+0000 7f8fd8ff96c0 1 -- 10.20.193.78:0/3424772687 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fcc00ce70 con 0x7f8fdc115410 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.969+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc163cd0 con 0x7f8fdc115410 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.969+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc164160 con 0x7f8fdc115410 2026-02-13T02:42:09.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.969+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc1104d0 con 0x7f8fdc115410 2026-02-13T02:42:09.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.971+0000 7f8fd8ff96c0 1 -- 10.20.193.78:0/3424772687 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8fcc004060 con 0x7f8fdc115410 2026-02-13T02:42:09.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.973+0000 7f8fd8ff96c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8fb00b5760 0x7f8fb00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:09.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.973+0000 7f8fd8ff96c0 1 -- 10.20.193.78:0/3424772687 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f8fcc0e3b60 con 0x7f8fdc115410 2026-02-13T02:42:09.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.973+0000 7f8fd8ff96c0 1 -- 10.20.193.78:0/3424772687 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8fcc11c5e0 con 0x7f8fdc115410 2026-02-13T02:42:09.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.973+0000 7f8fdb7fe6c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8fb00b5760 0x7f8fb00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:09.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:09.974+0000 7f8fdb7fe6c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8fb00b5760 0x7f8fb00d5c10 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc802f950 tx=0x7f8fc80023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:10.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:09 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2443653220' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:42:10.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:09 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1520869250' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:42:10.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:09 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2035770421' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:42:10.073 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.071+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fdc10fbf0 con 0x7f8fb00b5760 2026-02-13T02:42:10.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.074+0000 7f8fd8ff96c0 1 -- 10.20.193.78:0/3424772687 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259011 (secure 0 0 0) 0x7f8fdc10fbf0 con 0x7f8fb00b5760 2026-02-13T02:42:10.079 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:10.081 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T02:42:10.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8fb00b5760 msgr2=0x7f8fb00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:10.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8fb00b5760 0x7f8fb00d5c10 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc802f950 tx=0x7f8fc80023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 msgr2=0x7f8fdc11d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:10.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 0x7f8fdc11d720 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc00b800 tx=0x7f8fcc00bcd0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 shutdown_connections 2026-02-13T02:42:10.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8fb00b5760 0x7f8fb00d5c10 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.083 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8fdc122ae0 0x7f8fdc122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8fdc115410 0x7f8fdc11d720 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 --2- 10.20.193.78:0/3424772687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8fdc10f200 0x7f8fdc11d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 >> 10.20.193.78:0/3424772687 conn(0x7f8fdc0ecb00 msgr2=0x7f8fdc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:10.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 shutdown_connections 2026-02-13T02:42:10.084 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.077+0000 7f8fe1b786c0 1 -- 10.20.193.78:0/3424772687 wait complete. 2026-02-13T02:42:10.180 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-13T02:42:09.623687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660452,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":243,"num_read_kb":240,"num_write":427,"num_write_kb":3859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":359,"ondisk_log_size":359,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333840,"kb_used_data":10272,"kb_used_omap":451,"kb_used_meta":322876,"kb_avail":8807704560,"statfs":{"total":9019431321600,"available":9019089469440,"internally_reserved":0,"allocated":10518528,"data_stored":6751056,"data_compressed":114759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":462058,"internal_metadata":330625814},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64214,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":129,"num_read_kb":141,"num_write":143,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003149"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753798+0000","last_change":"2026-02-13T02:41:50.599914+0000","last_active":"2026-02-13T02:41:51.753798+0000","last_peered":"2026-02-13T02:41:51.753798+0000","last_clean":"2026-02-13T02:41:51.753798+0000","last_became_active":"2026-02-13T02:41:50.599730+0000","last_became_peered":"2026-02-13T02:41:50.599730+0000","last_unstale":"2026-02-13T02:41:51.753798+0000","last_undegraded":"2026-02-13T02:41:51.753798+0000","last_fullsized":"2026-02-13T02:41:51.753798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:03:13.109709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756660+0000","last_change":"2026-02-13T02:41:50.600052+0000","last_active":"2026-02-13T02:41:51.756660+0000","last_peered":"2026-02-13T02:41:51.756660+0000","last_clean":"2026-02-13T02:41:51.756660+0000","last_became_active":"2026-02-13T02:41:50.599602+0000","last_became_peered":"2026-02-13T02:41:50.599602+0000","last_unstale":"2026-02-13T02:41:51.756660+0000","last_undegraded":"2026-02-13T02:41:51.756660+0000","last_fullsized":"2026-02-13T02:41:51.756660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:52.030776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756493+0000","last_change":"2026-02-13T02:41:50.603536+0000","last_active":"2026-02-13T02:41:51.756493+0000","last_peered":"2026-02-13T02:41:51.756493+0000","last_clean":"2026-02-13T02:41:51.756493+0000","last_became_active":"2026-02-13T02:41:50.603397+0000","last_became_peered":"2026-02-13T02:41:50.603397+0000","last_unstale":"2026-02-13T02:41:51.756493+0000","last_undegraded":"2026-02-13T02:41:51.756493+0000","last_fullsized":"2026-02-13T02:41:51.756493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:53.008982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.757018+0000","last_change":"2026-02-13T02:41:50.605058+0000","last_active":"2026-02-13T02:41:51.757018+0000","last_peered":"2026-02-13T02:41:51.757018+0000","last_clean":"2026-02-13T02:41:51.757018+0000","last_became_active":"2026-02-13T02:41:50.604762+0000","last_became_peered":"2026-02-13T02:41:50.604762+0000","last_unstale":"2026-02-13T02:41:51.757018+0000","last_undegraded":"2026-02-13T02:41:51.757018+0000","last_fullsized":"2026-02-13T02:41:51.757018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:25.425794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638592+0000","last_change":"2026-02-13T02:41:50.603698+0000","last_active":"2026-02-13T02:41:51.638592+0000","last_peered":"2026-02-13T02:41:51.638592+0000","last_clean":"2026-02-13T02:41:51.638592+0000","last_became_active":"2026-02-13T02:41:50.603555+0000","last_became_peered":"2026-02-13T02:41:50.603555+0000","last_unstale":"2026-02-13T02:41:51.638592+0000","last_undegraded":"2026-02-13T02:41:51.638592+0000","last_fullsized":"2026-02-13T02:41:51.638592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:05.519511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598097+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.598097+0000","last_peered":"2026-02-13T02:41:51.598097+0000","last_clean":"2026-02-13T02:41:51.598097+0000","last_became_active":"2026-02-13T02:41:50.607050+0000","last_became_peered":"2026-02-13T02:41:50.607050+0000","last_unstale":"2026-02-13T02:41:51.598097+0000","last_undegraded":"2026-02-13T02:41:51.598097+0000","last_fullsized":"2026-02-13T02:41:51.598097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:36.348221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685915+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.685915+0000","last_peered":"2026-02-13T02:41:51.685915+0000","last_clean":"2026-02-13T02:41:51.685915+0000","last_became_active":"2026-02-13T02:41:50.607052+0000","last_became_peered":"2026-02-13T02:41:50.607052+0000","last_unstale":"2026-02-13T02:41:51.685915+0000","last_undegraded":"2026-02-13T02:41:51.685915+0000","last_fullsized":"2026-02-13T02:41:51.685915+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:09.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596911+0000","last_change":"2026-02-13T02:41:50.606858+0000","last_active":"2026-02-13T02:41:51.596911+0000","last_peered":"2026-02-13T02:41:51.596911+0000","last_clean":"2026-02-13T02:41:51.596911+0000","last_became_active":"2026-02-13T02:41:50.606045+0000","last_became_peered":"2026-02-13T02:41:50.606045+0000","last_unstale":"2026-02-13T02:41:51.596911+0000","last_undegraded":"2026-02-13T02:41:51.596911+0000","last_fullsized":"2026-02-13T02:41:51.596911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:05.276035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756934+0000","last_change":"2026-02-13T02:41:50.604103+0000","last_active":"2026-02-13T02:41:51.756934+0000","last_peered":"2026-02-13T02:41:51.756934+0000","last_clean":"2026-02-13T02:41:51.756934+0000","last_became_active":"2026-02-13T02:41:50.603863+0000","last_became_peered":"2026-02-13T02:41:50.603863+0000","last_unstale":"2026-02-13T02:41:51.756934+0000","last_undegraded":"2026-02-13T02:41:51.756934+0000","last_fullsized":"2026-02-13T02:41:51.756934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:35:13.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598569+0000","last_change":"2026-02-13T02:41:50.604086+0000","last_active":"2026-02-13T02:41:51.598569+0000","last_peered":"2026-02-13T02:41:51.598569+0000","last_clean":"2026-02-13T02:41:51.598569+0000","last_became_active":"2026-02-13T02:41:50.603680+0000","last_became_peered":"2026-02-13T02:41:50.603680+0000","last_unstale":"2026-02-13T02:41:51.598569+0000","last_undegraded":"2026-02-13T02:41:51.598569+0000","last_fullsized":"2026-02-13T02:41:51.598569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:24:37.164379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686176+0000","last_change":"2026-02-13T02:41:50.605319+0000","last_active":"2026-02-13T02:41:51.686176+0000","last_peered":"2026-02-13T02:41:51.686176+0000","last_clean":"2026-02-13T02:41:51.686176+0000","last_became_active":"2026-02-13T02:41:50.605054+0000","last_became_peered":"2026-02-13T02:41:50.605054+0000","last_unstale":"2026-02-13T02:41:51.686176+0000","last_undegraded":"2026-02-13T02:41:51.686176+0000","last_fullsized":"2026-02-13T02:41:51.686176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:25:10.690555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756968+0000","last_change":"2026-02-13T02:41:50.604779+0000","last_active":"2026-02-13T02:41:51.756968+0000","last_peered":"2026-02-13T02:41:51.756968+0000","last_clean":"2026-02-13T02:41:51.756968+0000","last_became_active":"2026-02-13T02:41:50.604459+0000","last_became_peered":"2026-02-13T02:41:50.604459+0000","last_unstale":"2026-02-13T02:41:51.756968+0000","last_undegraded":"2026-02-13T02:41:51.756968+0000","last_fullsized":"2026-02-13T02:41:51.756968+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:56:44.125622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756288+0000","last_change":"2026-02-13T02:41:50.605422+0000","last_active":"2026-02-13T02:41:51.756288+0000","last_peered":"2026-02-13T02:41:51.756288+0000","last_clean":"2026-02-13T02:41:51.756288+0000","last_became_active":"2026-02-13T02:41:50.605329+0000","last_became_peered":"2026-02-13T02:41:50.605329+0000","last_unstale":"2026-02-13T02:41:51.756288+0000","last_undegraded":"2026-02-13T02:41:51.756288+0000","last_fullsized":"2026-02-13T02:41:51.756288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:16.056010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755988+0000","last_change":"2026-02-13T02:41:50.602168+0000","last_active":"2026-02-13T02:41:51.755988+0000","last_peered":"2026-02-13T02:41:51.755988+0000","last_clean":"2026-02-13T02:41:51.755988+0000","last_became_active":"2026-02-13T02:41:50.601828+0000","last_became_peered":"2026-02-13T02:41:50.601828+0000","last_unstale":"2026-02-13T02:41:51.755988+0000","last_undegraded":"2026-02-13T02:41:51.755988+0000","last_fullsized":"2026-02-13T02:41:51.755988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:44.301005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756057+0000","last_change":"2026-02-13T02:41:50.603578+0000","last_active":"2026-02-13T02:41:51.756057+0000","last_peered":"2026-02-13T02:41:51.756057+0000","last_clean":"2026-02-13T02:41:51.756057+0000","last_became_active":"2026-02-13T02:41:50.603419+0000","last_became_peered":"2026-02-13T02:41:50.603419+0000","last_unstale":"2026-02-13T02:41:51.756057+0000","last_undegraded":"2026-02-13T02:41:51.756057+0000","last_fullsized":"2026-02-13T02:41:51.756057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:51:21.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756604+0000","last_change":"2026-02-13T02:41:50.604104+0000","last_active":"2026-02-13T02:41:51.756604+0000","last_peered":"2026-02-13T02:41:51.756604+0000","last_clean":"2026-02-13T02:41:51.756604+0000","last_became_active":"2026-02-13T02:41:50.603842+0000","last_became_peered":"2026-02-13T02:41:50.603842+0000","last_unstale":"2026-02-13T02:41:51.756604+0000","last_undegraded":"2026-02-13T02:41:51.756604+0000","last_fullsized":"2026-02-13T02:41:51.756604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:39:14.046728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753888+0000","last_change":"2026-02-13T02:41:50.600064+0000","last_active":"2026-02-13T02:41:51.753888+0000","last_peered":"2026-02-13T02:41:51.753888+0000","last_clean":"2026-02-13T02:41:51.753888+0000","last_became_active":"2026-02-13T02:41:50.599816+0000","last_became_peered":"2026-02-13T02:41:50.599816+0000","last_unstale":"2026-02-13T02:41:51.753888+0000","last_undegraded":"2026-02-13T02:41:51.753888+0000","last_fullsized":"2026-02-13T02:41:51.753888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:21.509074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756002+0000","last_change":"2026-02-13T02:41:50.603623+0000","last_active":"2026-02-13T02:41:51.756002+0000","last_peered":"2026-02-13T02:41:51.756002+0000","last_clean":"2026-02-13T02:41:51.756002+0000","last_became_active":"2026-02-13T02:41:50.603557+0000","last_became_peered":"2026-02-13T02:41:50.603557+0000","last_unstale":"2026-02-13T02:41:51.756002+0000","last_undegraded":"2026-02-13T02:41:51.756002+0000","last_fullsized":"2026-02-13T02:41:51.756002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:43.142827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594535+0000","last_change":"2026-02-13T02:41:50.604758+0000","last_active":"2026-02-13T02:41:51.594535+0000","last_peered":"2026-02-13T02:41:51.594535+0000","last_clean":"2026-02-13T02:41:51.594535+0000","last_became_active":"2026-02-13T02:41:50.604617+0000","last_became_peered":"2026-02-13T02:41:50.604617+0000","last_unstale":"2026-02-13T02:41:51.594535+0000","last_undegraded":"2026-02-13T02:41:51.594535+0000","last_fullsized":"2026-02-13T02:41:51.594535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:50.763524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753576+0000","last_change":"2026-02-13T02:41:50.601097+0000","last_active":"2026-02-13T02:41:51.753576+0000","last_peered":"2026-02-13T02:41:51.753576+0000","last_clean":"2026-02-13T02:41:51.753576+0000","last_became_active":"2026-02-13T02:41:50.600904+0000","last_became_peered":"2026-02-13T02:41:50.600904+0000","last_unstale":"2026-02-13T02:41:51.753576+0000","last_undegraded":"2026-02-13T02:41:51.753576+0000","last_fullsized":"2026-02-13T02:41:51.753576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:28:11.088460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756282+0000","last_change":"2026-02-13T02:41:50.610769+0000","last_active":"2026-02-13T02:41:51.756282+0000","last_peered":"2026-02-13T02:41:51.756282+0000","last_clean":"2026-02-13T02:41:51.756282+0000","last_became_active":"2026-02-13T02:41:50.610617+0000","last_became_peered":"2026-02-13T02:41:50.610617+0000","last_unstale":"2026-02-13T02:41:51.756282+0000","last_undegraded":"2026-02-13T02:41:51.756282+0000","last_fullsized":"2026-02-13T02:41:51.756282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:46.547410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756657+0000","last_change":"2026-02-13T02:41:50.607490+0000","last_active":"2026-02-13T02:41:51.756657+0000","last_peered":"2026-02-13T02:41:51.756657+0000","last_clean":"2026-02-13T02:41:51.756657+0000","last_became_active":"2026-02-13T02:41:50.607298+0000","last_became_peered":"2026-02-13T02:41:50.607298+0000","last_unstale":"2026-02-13T02:41:51.756657+0000","last_undegraded":"2026-02-13T02:41:51.756657+0000","last_fullsized":"2026-02-13T02:41:51.756657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:07.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596921+0000","last_change":"2026-02-13T02:41:50.606974+0000","last_active":"2026-02-13T02:41:51.596921+0000","last_peered":"2026-02-13T02:41:51.596921+0000","last_clean":"2026-02-13T02:41:51.596921+0000","last_became_active":"2026-02-13T02:41:50.606344+0000","last_became_peered":"2026-02-13T02:41:50.606344+0000","last_unstale":"2026-02-13T02:41:51.596921+0000","last_undegraded":"2026-02-13T02:41:51.596921+0000","last_fullsized":"2026-02-13T02:41:51.596921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:12.593325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594547+0000","last_change":"2026-02-13T02:41:50.605952+0000","last_active":"2026-02-13T02:41:51.594547+0000","last_peered":"2026-02-13T02:41:51.594547+0000","last_clean":"2026-02-13T02:41:51.594547+0000","last_became_active":"2026-02-13T02:41:50.605843+0000","last_became_peered":"2026-02-13T02:41:50.605843+0000","last_unstale":"2026-02-13T02:41:51.594547+0000","last_undegraded":"2026-02-13T02:41:51.594547+0000","last_fullsized":"2026-02-13T02:41:51.594547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:43:56.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597412+0000","last_change":"2026-02-13T02:41:50.607967+0000","last_active":"2026-02-13T02:41:51.597412+0000","last_peered":"2026-02-13T02:41:51.597412+0000","last_clean":"2026-02-13T02:41:51.597412+0000","last_became_active":"2026-02-13T02:41:50.607467+0000","last_became_peered":"2026-02-13T02:41:50.607467+0000","last_unstale":"2026-02-13T02:41:51.597412+0000","last_undegraded":"2026-02-13T02:41:51.597412+0000","last_fullsized":"2026-02-13T02:41:51.597412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:02.579210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594625+0000","last_change":"2026-02-13T02:41:50.599821+0000","last_active":"2026-02-13T02:41:51.594625+0000","last_peered":"2026-02-13T02:41:51.594625+0000","last_clean":"2026-02-13T02:41:51.594625+0000","last_became_active":"2026-02-13T02:41:50.599654+0000","last_became_peered":"2026-02-13T02:41:50.599654+0000","last_unstale":"2026-02-13T02:41:51.594625+0000","last_undegraded":"2026-02-13T02:41:51.594625+0000","last_fullsized":"2026-02-13T02:41:51.594625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:32:20.138295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753717+0000","last_change":"2026-02-13T02:41:50.600422+0000","last_active":"2026-02-13T02:41:51.753717+0000","last_peered":"2026-02-13T02:41:51.753717+0000","last_clean":"2026-02-13T02:41:51.753717+0000","last_became_active":"2026-02-13T02:41:50.600118+0000","last_became_peered":"2026-02-13T02:41:50.600118+0000","last_unstale":"2026-02-13T02:41:51.753717+0000","last_undegraded":"2026-02-13T02:41:51.753717+0000","last_fullsized":"2026-02-13T02:41:51.753717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:18:51.209188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756265+0000","last_change":"2026-02-13T02:41:50.611343+0000","last_active":"2026-02-13T02:41:51.756265+0000","last_peered":"2026-02-13T02:41:51.756265+0000","last_clean":"2026-02-13T02:41:51.756265+0000","last_became_active":"2026-02-13T02:41:50.611129+0000","last_became_peered":"2026-02-13T02:41:50.611129+0000","last_unstale":"2026-02-13T02:41:51.756265+0000","last_undegraded":"2026-02-13T02:41:51.756265+0000","last_fullsized":"2026-02-13T02:41:51.756265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:26.181721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756482+0000","last_change":"2026-02-13T02:41:50.610427+0000","last_active":"2026-02-13T02:41:51.756482+0000","last_peered":"2026-02-13T02:41:51.756482+0000","last_clean":"2026-02-13T02:41:51.756482+0000","last_became_active":"2026-02-13T02:41:50.609859+0000","last_became_peered":"2026-02-13T02:41:50.609859+0000","last_unstale":"2026-02-13T02:41:51.756482+0000","last_undegraded":"2026-02-13T02:41:51.756482+0000","last_fullsized":"2026-02-13T02:41:51.756482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:35:38.289372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594356+0000","last_change":"2026-02-13T02:41:50.606399+0000","last_active":"2026-02-13T02:41:51.594356+0000","last_peered":"2026-02-13T02:41:51.594356+0000","last_clean":"2026-02-13T02:41:51.594356+0000","last_became_active":"2026-02-13T02:41:50.606261+0000","last_became_peered":"2026-02-13T02:41:50.606261+0000","last_unstale":"2026-02-13T02:41:51.594356+0000","last_undegraded":"2026-02-13T02:41:51.594356+0000","last_fullsized":"2026-02-13T02:41:51.594356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:35.087843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594337+0000","last_change":"2026-02-13T02:41:50.600540+0000","last_active":"2026-02-13T02:41:51.594337+0000","last_peered":"2026-02-13T02:41:51.594337+0000","last_clean":"2026-02-13T02:41:51.594337+0000","last_became_active":"2026-02-13T02:41:50.600370+0000","last_became_peered":"2026-02-13T02:41:50.600370+0000","last_unstale":"2026-02-13T02:41:51.594337+0000","last_undegraded":"2026-02-13T02:41:51.594337+0000","last_fullsized":"2026-02-13T02:41:51.594337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:42.274036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753590+0000","last_change":"2026-02-13T02:41:50.602084+0000","last_active":"2026-02-13T02:41:51.753590+0000","last_peered":"2026-02-13T02:41:51.753590+0000","last_clean":"2026-02-13T02:41:51.753590+0000","last_became_active":"2026-02-13T02:41:50.601938+0000","last_became_peered":"2026-02-13T02:41:50.601938+0000","last_unstale":"2026-02-13T02:41:51.753590+0000","last_undegraded":"2026-02-13T02:41:51.753590+0000","last_fullsized":"2026-02-13T02:41:51.753590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:12:44.963129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638688+0000","last_change":"2026-02-13T02:41:50.602908+0000","last_active":"2026-02-13T02:41:51.638688+0000","last_peered":"2026-02-13T02:41:51.638688+0000","last_clean":"2026-02-13T02:41:51.638688+0000","last_became_active":"2026-02-13T02:41:50.602815+0000","last_became_peered":"2026-02-13T02:41:50.602815+0000","last_unstale":"2026-02-13T02:41:51.638688+0000","last_undegraded":"2026-02-13T02:41:51.638688+0000","last_fullsized":"2026-02-13T02:41:51.638688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:51:10.405979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:05.646883+0000","last_change":"2026-02-13T02:41:49.595741+0000","last_active":"2026-02-13T02:42:05.646883+0000","last_peered":"2026-02-13T02:42:05.646883+0000","last_clean":"2026-02-13T02:42:05.646883+0000","last_became_active":"2026-02-13T02:41:49.595588+0000","last_became_peered":"2026-02-13T02:41:49.595588+0000","last_unstale":"2026-02-13T02:42:05.646883+0000","last_undegraded":"2026-02-13T02:42:05.646883+0000","last_fullsized":"2026-02-13T02:42:05.646883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:16.074126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594578+0000","last_change":"2026-02-13T02:41:50.604001+0000","last_active":"2026-02-13T02:41:51.594578+0000","last_peered":"2026-02-13T02:41:51.594578+0000","last_clean":"2026-02-13T02:41:51.594578+0000","last_became_active":"2026-02-13T02:41:50.603876+0000","last_became_peered":"2026-02-13T02:41:50.603876+0000","last_unstale":"2026-02-13T02:41:51.594578+0000","last_undegraded":"2026-02-13T02:41:51.594578+0000","last_fullsized":"2026-02-13T02:41:51.594578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:24:01.725748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.636482+0000","last_change":"2026-02-13T02:41:49.604405+0000","last_active":"2026-02-13T02:41:56.636482+0000","last_peered":"2026-02-13T02:41:56.636482+0000","last_clean":"2026-02-13T02:41:56.636482+0000","last_became_active":"2026-02-13T02:41:49.604257+0000","last_became_peered":"2026-02-13T02:41:49.604257+0000","last_unstale":"2026-02-13T02:41:56.636482+0000","last_undegraded":"2026-02-13T02:41:56.636482+0000","last_fullsized":"2026-02-13T02:41:56.636482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:45.835163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.630743+0000","last_change":"2026-02-13T02:41:49.601797+0000","last_active":"2026-02-13T02:41:55.630743+0000","last_peered":"2026-02-13T02:41:55.630743+0000","last_clean":"2026-02-13T02:41:55.630743+0000","last_became_active":"2026-02-13T02:41:49.601398+0000","last_became_peered":"2026-02-13T02:41:49.601398+0000","last_unstale":"2026-02-13T02:41:55.630743+0000","last_undegraded":"2026-02-13T02:41:55.630743+0000","last_fullsized":"2026-02-13T02:41:55.630743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:37.346955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596989+0000","last_change":"2026-02-13T02:41:50.606972+0000","last_active":"2026-02-13T02:41:51.596989+0000","last_peered":"2026-02-13T02:41:51.596989+0000","last_clean":"2026-02-13T02:41:51.596989+0000","last_became_active":"2026-02-13T02:41:50.606736+0000","last_became_peered":"2026-02-13T02:41:50.606736+0000","last_unstale":"2026-02-13T02:41:51.596989+0000","last_undegraded":"2026-02-13T02:41:51.596989+0000","last_fullsized":"2026-02-13T02:41:51.596989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:46.423039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639593+0000","last_change":"2026-02-13T02:41:49.595837+0000","last_active":"2026-02-13T02:41:57.639593+0000","last_peered":"2026-02-13T02:41:57.639593+0000","last_clean":"2026-02-13T02:41:57.639593+0000","last_became_active":"2026-02-13T02:41:49.595704+0000","last_became_peered":"2026-02-13T02:41:49.595704+0000","last_unstale":"2026-02-13T02:41:57.639593+0000","last_undegraded":"2026-02-13T02:41:57.639593+0000","last_fullsized":"2026-02-13T02:41:57.639593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:01:23.763609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756049+0000","last_change":"2026-02-13T02:41:50.611914+0000","last_active":"2026-02-13T02:41:51.756049+0000","last_peered":"2026-02-13T02:41:51.756049+0000","last_clean":"2026-02-13T02:41:51.756049+0000","last_became_active":"2026-02-13T02:41:50.611636+0000","last_became_peered":"2026-02-13T02:41:50.611636+0000","last_unstale":"2026-02-13T02:41:51.756049+0000","last_undegraded":"2026-02-13T02:41:51.756049+0000","last_fullsized":"2026-02-13T02:41:51.756049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:52:16.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:06.650455+0000","last_change":"2026-02-13T02:41:49.601592+0000","last_active":"2026-02-13T02:42:06.650455+0000","last_peered":"2026-02-13T02:42:06.650455+0000","last_clean":"2026-02-13T02:42:06.650455+0000","last_became_active":"2026-02-13T02:41:49.601466+0000","last_became_peered":"2026-02-13T02:41:49.601466+0000","last_unstale":"2026-02-13T02:42:06.650455+0000","last_undegraded":"2026-02-13T02:42:06.650455+0000","last_fullsized":"2026-02-13T02:42:06.650455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:54.238406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756898+0000","last_change":"2026-02-13T02:41:50.605957+0000","last_active":"2026-02-13T02:41:51.756898+0000","last_peered":"2026-02-13T02:41:51.756898+0000","last_clean":"2026-02-13T02:41:51.756898+0000","last_became_active":"2026-02-13T02:41:50.605827+0000","last_became_peered":"2026-02-13T02:41:50.605827+0000","last_unstale":"2026-02-13T02:41:51.756898+0000","last_undegraded":"2026-02-13T02:41:51.756898+0000","last_fullsized":"2026-02-13T02:41:51.756898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:29.966443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643085+0000","last_change":"2026-02-13T02:41:49.599890+0000","last_active":"2026-02-13T02:41:57.643085+0000","last_peered":"2026-02-13T02:41:57.643085+0000","last_clean":"2026-02-13T02:41:57.643085+0000","last_became_active":"2026-02-13T02:41:49.599626+0000","last_became_peered":"2026-02-13T02:41:49.599626+0000","last_unstale":"2026-02-13T02:41:57.643085+0000","last_undegraded":"2026-02-13T02:41:57.643085+0000","last_fullsized":"2026-02-13T02:41:57.643085+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:27:44.242839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756712+0000","last_change":"2026-02-13T02:41:50.608740+0000","last_active":"2026-02-13T02:41:51.756712+0000","last_peered":"2026-02-13T02:41:51.756712+0000","last_clean":"2026-02-13T02:41:51.756712+0000","last_became_active":"2026-02-13T02:41:50.607195+0000","last_became_peered":"2026-02-13T02:41:50.607195+0000","last_unstale":"2026-02-13T02:41:51.756712+0000","last_undegraded":"2026-02-13T02:41:51.756712+0000","last_fullsized":"2026-02-13T02:41:51.756712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:44.460181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.633992+0000","last_change":"2026-02-13T02:41:49.600637+0000","last_active":"2026-02-13T02:41:56.633992+0000","last_peered":"2026-02-13T02:41:56.633992+0000","last_clean":"2026-02-13T02:41:56.633992+0000","last_became_active":"2026-02-13T02:41:49.600502+0000","last_became_peered":"2026-02-13T02:41:49.600502+0000","last_unstale":"2026-02-13T02:41:56.633992+0000","last_undegraded":"2026-02-13T02:41:56.633992+0000","last_fullsized":"2026-02-13T02:41:56.633992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:42:59.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756802+0000","last_change":"2026-02-13T02:41:50.605595+0000","last_active":"2026-02-13T02:41:51.756802+0000","last_peered":"2026-02-13T02:41:51.756802+0000","last_clean":"2026-02-13T02:41:51.756802+0000","last_became_active":"2026-02-13T02:41:50.605404+0000","last_became_peered":"2026-02-13T02:41:50.605404+0000","last_unstale":"2026-02-13T02:41:51.756802+0000","last_undegraded":"2026-02-13T02:41:51.756802+0000","last_fullsized":"2026-02-13T02:41:51.756802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:15.374790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:06.652562+0000","last_change":"2026-02-13T02:41:49.600871+0000","last_active":"2026-02-13T02:42:06.652562+0000","last_peered":"2026-02-13T02:42:06.652562+0000","last_clean":"2026-02-13T02:42:06.652562+0000","last_became_active":"2026-02-13T02:41:49.600717+0000","last_became_peered":"2026-02-13T02:41:49.600717+0000","last_unstale":"2026-02-13T02:42:06.652562+0000","last_undegraded":"2026-02-13T02:42:06.652562+0000","last_fullsized":"2026-02-13T02:42:06.652562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:03.550683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62088,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":72,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638813+0000","last_change":"2026-02-13T02:41:50.601869+0000","last_active":"2026-02-13T02:41:51.638813+0000","last_peered":"2026-02-13T02:41:51.638813+0000","last_clean":"2026-02-13T02:41:51.638813+0000","last_became_active":"2026-02-13T02:41:50.601753+0000","last_became_peered":"2026-02-13T02:41:50.601753+0000","last_unstale":"2026-02-13T02:41:51.638813+0000","last_undegraded":"2026-02-13T02:41:51.638813+0000","last_fullsized":"2026-02-13T02:41:51.638813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:53.246854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.640971+0000","last_change":"2026-02-13T02:41:49.605257+0000","last_active":"2026-02-13T02:41:58.640971+0000","last_peered":"2026-02-13T02:41:58.640971+0000","last_clean":"2026-02-13T02:41:58.640971+0000","last_became_active":"2026-02-13T02:41:49.605162+0000","last_became_peered":"2026-02-13T02:41:49.605162+0000","last_unstale":"2026-02-13T02:41:58.640971+0000","last_undegraded":"2026-02-13T02:41:58.640971+0000","last_fullsized":"2026-02-13T02:41:58.640971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:46.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756594+0000","last_change":"2026-02-13T02:41:50.608778+0000","last_active":"2026-02-13T02:41:51.756594+0000","last_peered":"2026-02-13T02:41:51.756594+0000","last_clean":"2026-02-13T02:41:51.756594+0000","last_became_active":"2026-02-13T02:41:50.608686+0000","last_became_peered":"2026-02-13T02:41:50.608686+0000","last_unstale":"2026-02-13T02:41:51.756594+0000","last_undegraded":"2026-02-13T02:41:51.756594+0000","last_fullsized":"2026-02-13T02:41:51.756594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:01.765041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.640807+0000","last_change":"2026-02-13T02:41:49.603081+0000","last_active":"2026-02-13T02:41:57.640807+0000","last_peered":"2026-02-13T02:41:57.640807+0000","last_clean":"2026-02-13T02:41:57.640807+0000","last_became_active":"2026-02-13T02:41:49.602818+0000","last_became_peered":"2026-02-13T02:41:49.602818+0000","last_unstale":"2026-02-13T02:41:57.640807+0000","last_undegraded":"2026-02-13T02:41:57.640807+0000","last_fullsized":"2026-02-13T02:41:57.640807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:55.523356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686167+0000","last_change":"2026-02-13T02:41:50.606663+0000","last_active":"2026-02-13T02:41:51.686167+0000","last_peered":"2026-02-13T02:41:51.686167+0000","last_clean":"2026-02-13T02:41:51.686167+0000","last_became_active":"2026-02-13T02:41:50.606460+0000","last_became_peered":"2026-02-13T02:41:50.606460+0000","last_unstale":"2026-02-13T02:41:51.686167+0000","last_undegraded":"2026-02-13T02:41:51.686167+0000","last_fullsized":"2026-02-13T02:41:51.686167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:23:24.744253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:07.659578+0000","last_change":"2026-02-13T02:41:49.597626+0000","last_active":"2026-02-13T02:42:07.659578+0000","last_peered":"2026-02-13T02:42:07.659578+0000","last_clean":"2026-02-13T02:42:07.659578+0000","last_became_active":"2026-02-13T02:41:49.597177+0000","last_became_peered":"2026-02-13T02:41:49.597177+0000","last_unstale":"2026-02-13T02:42:07.659578+0000","last_undegraded":"2026-02-13T02:42:07.659578+0000","last_fullsized":"2026-02-13T02:42:07.659578+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:43.194968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685920+0000","last_change":"2026-02-13T02:41:50.605190+0000","last_active":"2026-02-13T02:41:51.685920+0000","last_peered":"2026-02-13T02:41:51.685920+0000","last_clean":"2026-02-13T02:41:51.685920+0000","last_became_active":"2026-02-13T02:41:50.604929+0000","last_became_peered":"2026-02-13T02:41:50.604929+0000","last_unstale":"2026-02-13T02:41:51.685920+0000","last_undegraded":"2026-02-13T02:41:51.685920+0000","last_fullsized":"2026-02-13T02:41:51.685920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:41:19.216490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639971+0000","last_change":"2026-02-13T02:41:49.597710+0000","last_active":"2026-02-13T02:41:57.639971+0000","last_peered":"2026-02-13T02:41:57.639971+0000","last_clean":"2026-02-13T02:41:57.639971+0000","last_became_active":"2026-02-13T02:41:49.597545+0000","last_became_peered":"2026-02-13T02:41:49.597545+0000","last_unstale":"2026-02-13T02:41:57.639971+0000","last_undegraded":"2026-02-13T02:41:57.639971+0000","last_fullsized":"2026-02-13T02:41:57.639971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:40.978704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594383+0000","last_change":"2026-02-13T02:41:50.602185+0000","last_active":"2026-02-13T02:41:51.594383+0000","last_peered":"2026-02-13T02:41:51.594383+0000","last_clean":"2026-02-13T02:41:51.594383+0000","last_became_active":"2026-02-13T02:41:50.602029+0000","last_became_peered":"2026-02-13T02:41:50.602029+0000","last_unstale":"2026-02-13T02:41:51.594383+0000","last_undegraded":"2026-02-13T02:41:51.594383+0000","last_fullsized":"2026-02-13T02:41:51.594383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:44:46.598780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.624545+0000","last_change":"2026-02-13T02:41:49.596995+0000","last_active":"2026-02-13T02:41:57.624545+0000","last_peered":"2026-02-13T02:41:57.624545+0000","last_clean":"2026-02-13T02:41:57.624545+0000","last_became_active":"2026-02-13T02:41:49.596572+0000","last_became_peered":"2026-02-13T02:41:49.596572+0000","last_unstale":"2026-02-13T02:41:57.624545+0000","last_undegraded":"2026-02-13T02:41:57.624545+0000","last_fullsized":"2026-02-13T02:41:57.624545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:02.816921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753645+0000","last_change":"2026-02-13T02:41:50.600695+0000","last_active":"2026-02-13T02:41:51.753645+0000","last_peered":"2026-02-13T02:41:51.753645+0000","last_clean":"2026-02-13T02:41:51.753645+0000","last_became_active":"2026-02-13T02:41:50.600453+0000","last_became_peered":"2026-02-13T02:41:50.600453+0000","last_unstale":"2026-02-13T02:41:51.753645+0000","last_undegraded":"2026-02-13T02:41:51.753645+0000","last_fullsized":"2026-02-13T02:41:51.753645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:50:55.092606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643996+0000","last_change":"2026-02-13T02:41:49.607644+0000","last_active":"2026-02-13T02:41:57.643996+0000","last_peered":"2026-02-13T02:41:57.643996+0000","last_clean":"2026-02-13T02:41:57.643996+0000","last_became_active":"2026-02-13T02:41:49.607523+0000","last_became_peered":"2026-02-13T02:41:49.607523+0000","last_unstale":"2026-02-13T02:41:57.643996+0000","last_undegraded":"2026-02-13T02:41:57.643996+0000","last_fullsized":"2026-02-13T02:41:57.643996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:38.869550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686358+0000","last_change":"2026-02-13T02:41:50.603530+0000","last_active":"2026-02-13T02:41:51.686358+0000","last_peered":"2026-02-13T02:41:51.686358+0000","last_clean":"2026-02-13T02:41:51.686358+0000","last_became_active":"2026-02-13T02:41:50.603312+0000","last_became_peered":"2026-02-13T02:41:50.603312+0000","last_unstale":"2026-02-13T02:41:51.686358+0000","last_undegraded":"2026-02-13T02:41:51.686358+0000","last_fullsized":"2026-02-13T02:41:51.686358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:20.510472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.640687+0000","last_change":"2026-02-13T02:41:49.602974+0000","last_active":"2026-02-13T02:41:57.640687+0000","last_peered":"2026-02-13T02:41:57.640687+0000","last_clean":"2026-02-13T02:41:57.640687+0000","last_became_active":"2026-02-13T02:41:49.602734+0000","last_became_peered":"2026-02-13T02:41:49.602734+0000","last_unstale":"2026-02-13T02:41:57.640687+0000","last_undegraded":"2026-02-13T02:41:57.640687+0000","last_fullsized":"2026-02-13T02:41:57.640687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:55.811253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686213+0000","last_change":"2026-02-13T02:41:50.609569+0000","last_active":"2026-02-13T02:41:51.686213+0000","last_peered":"2026-02-13T02:41:51.686213+0000","last_clean":"2026-02-13T02:41:51.686213+0000","last_became_active":"2026-02-13T02:41:50.609385+0000","last_became_peered":"2026-02-13T02:41:50.609385+0000","last_unstale":"2026-02-13T02:41:51.686213+0000","last_undegraded":"2026-02-13T02:41:51.686213+0000","last_fullsized":"2026-02-13T02:41:51.686213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:01:38.361410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:05.647215+0000","last_change":"2026-02-13T02:41:49.597872+0000","last_active":"2026-02-13T02:42:05.647215+0000","last_peered":"2026-02-13T02:42:05.647215+0000","last_clean":"2026-02-13T02:42:05.647215+0000","last_became_active":"2026-02-13T02:41:49.597687+0000","last_became_peered":"2026-02-13T02:41:49.597687+0000","last_unstale":"2026-02-13T02:42:05.647215+0000","last_undegraded":"2026-02-13T02:42:05.647215+0000","last_fullsized":"2026-02-13T02:42:05.647215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:34:50.926874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686331+0000","last_change":"2026-02-13T02:41:50.603749+0000","last_active":"2026-02-13T02:41:51.686331+0000","last_peered":"2026-02-13T02:41:51.686331+0000","last_clean":"2026-02-13T02:41:51.686331+0000","last_became_active":"2026-02-13T02:41:50.603582+0000","last_became_peered":"2026-02-13T02:41:50.603582+0000","last_unstale":"2026-02-13T02:41:51.686331+0000","last_undegraded":"2026-02-13T02:41:51.686331+0000","last_fullsized":"2026-02-13T02:41:51.686331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:21:18.911738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686050+0000","last_change":"2026-02-13T02:41:25.005343+0000","last_active":"2026-02-13T02:41:51.686050+0000","last_peered":"2026-02-13T02:41:51.686050+0000","last_clean":"2026-02-13T02:41:51.686050+0000","last_became_active":"2026-02-13T02:41:25.005110+0000","last_became_peered":"2026-02-13T02:41:25.005110+0000","last_unstale":"2026-02-13T02:41:51.686050+0000","last_undegraded":"2026-02-13T02:41:51.686050+0000","last_fullsized":"2026-02-13T02:41:51.686050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_clean_scrub_stamp":"2026-02-13T02:40:11.017896+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:17.735016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.644630+0000","last_change":"2026-02-13T02:41:49.601087+0000","last_active":"2026-02-13T02:41:58.644630+0000","last_peered":"2026-02-13T02:41:58.644630+0000","last_clean":"2026-02-13T02:41:58.644630+0000","last_became_active":"2026-02-13T02:41:49.600937+0000","last_became_peered":"2026-02-13T02:41:49.600937+0000","last_unstale":"2026-02-13T02:41:58.644630+0000","last_undegraded":"2026-02-13T02:41:58.644630+0000","last_fullsized":"2026-02-13T02:41:58.644630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:00.587519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597194+0000","last_change":"2026-02-13T02:41:50.606319+0000","last_active":"2026-02-13T02:41:51.597194+0000","last_peered":"2026-02-13T02:41:51.597194+0000","last_clean":"2026-02-13T02:41:51.597194+0000","last_became_active":"2026-02-13T02:41:50.605323+0000","last_became_peered":"2026-02-13T02:41:50.605323+0000","last_unstale":"2026-02-13T02:41:51.597194+0000","last_undegraded":"2026-02-13T02:41:51.597194+0000","last_fullsized":"2026-02-13T02:41:51.597194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:30:37.743457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.629312+0000","last_change":"2026-02-13T02:41:49.599872+0000","last_active":"2026-02-13T02:41:55.629312+0000","last_peered":"2026-02-13T02:41:55.629312+0000","last_clean":"2026-02-13T02:41:55.629312+0000","last_became_active":"2026-02-13T02:41:49.599659+0000","last_became_peered":"2026-02-13T02:41:49.599659+0000","last_unstale":"2026-02-13T02:41:55.629312+0000","last_undegraded":"2026-02-13T02:41:55.629312+0000","last_fullsized":"2026-02-13T02:41:55.629312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:50:27.800392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755902+0000","last_change":"2026-02-13T02:41:50.604627+0000","last_active":"2026-02-13T02:41:51.755902+0000","last_peered":"2026-02-13T02:41:51.755902+0000","last_clean":"2026-02-13T02:41:51.755902+0000","last_became_active":"2026-02-13T02:41:50.604541+0000","last_became_peered":"2026-02-13T02:41:50.604541+0000","last_unstale":"2026-02-13T02:41:51.755902+0000","last_undegraded":"2026-02-13T02:41:51.755902+0000","last_fullsized":"2026-02-13T02:41:51.755902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:43.968495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:06.657196+0000","last_change":"2026-02-13T02:41:49.608418+0000","last_active":"2026-02-13T02:42:06.657196+0000","last_peered":"2026-02-13T02:42:06.657196+0000","last_clean":"2026-02-13T02:42:06.657196+0000","last_became_active":"2026-02-13T02:41:49.608146+0000","last_became_peered":"2026-02-13T02:41:49.608146+0000","last_unstale":"2026-02-13T02:42:06.657196+0000","last_undegraded":"2026-02-13T02:42:06.657196+0000","last_fullsized":"2026-02-13T02:42:06.657196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:51.291825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594339+0000","last_change":"2026-02-13T02:41:50.601808+0000","last_active":"2026-02-13T02:41:51.594339+0000","last_peered":"2026-02-13T02:41:51.594339+0000","last_clean":"2026-02-13T02:41:51.594339+0000","last_became_active":"2026-02-13T02:41:50.601452+0000","last_became_peered":"2026-02-13T02:41:50.601452+0000","last_unstale":"2026-02-13T02:41:51.594339+0000","last_undegraded":"2026-02-13T02:41:51.594339+0000","last_fullsized":"2026-02-13T02:41:51.594339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:33.347585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:04.652056+0000","last_change":"2026-02-13T02:41:49.602005+0000","last_active":"2026-02-13T02:42:04.652056+0000","last_peered":"2026-02-13T02:42:04.652056+0000","last_clean":"2026-02-13T02:42:04.652056+0000","last_became_active":"2026-02-13T02:41:49.601849+0000","last_became_peered":"2026-02-13T02:41:49.601849+0000","last_unstale":"2026-02-13T02:42:04.652056+0000","last_undegraded":"2026-02-13T02:42:04.652056+0000","last_fullsized":"2026-02-13T02:42:04.652056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:41.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598520+0000","last_change":"2026-02-13T02:41:50.605183+0000","last_active":"2026-02-13T02:41:51.598520+0000","last_peered":"2026-02-13T02:41:51.598520+0000","last_clean":"2026-02-13T02:41:51.598520+0000","last_became_active":"2026-02-13T02:41:50.604957+0000","last_became_peered":"2026-02-13T02:41:50.604957+0000","last_unstale":"2026-02-13T02:41:51.598520+0000","last_undegraded":"2026-02-13T02:41:51.598520+0000","last_fullsized":"2026-02-13T02:41:51.598520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:11.673149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756117+0000","last_change":"2026-02-13T02:41:49.600325+0000","last_active":"2026-02-13T02:41:51.756117+0000","last_peered":"2026-02-13T02:41:51.756117+0000","last_clean":"2026-02-13T02:41:51.756117+0000","last_became_active":"2026-02-13T02:41:49.600224+0000","last_became_peered":"2026-02-13T02:41:49.600224+0000","last_unstale":"2026-02-13T02:41:51.756117+0000","last_undegraded":"2026-02-13T02:41:51.756117+0000","last_fullsized":"2026-02-13T02:41:51.756117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:54.322610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.774595+0000","last_change":"2026-02-13T02:41:50.606498+0000","last_active":"2026-02-13T02:41:51.774595+0000","last_peered":"2026-02-13T02:41:51.774595+0000","last_clean":"2026-02-13T02:41:51.774595+0000","last_became_active":"2026-02-13T02:41:50.606363+0000","last_became_peered":"2026-02-13T02:41:50.606363+0000","last_unstale":"2026-02-13T02:41:51.774595+0000","last_undegraded":"2026-02-13T02:41:51.774595+0000","last_fullsized":"2026-02-13T02:41:51.774595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:01:26.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.642011+0000","last_change":"2026-02-13T02:41:49.598219+0000","last_active":"2026-02-13T02:41:57.642011+0000","last_peered":"2026-02-13T02:41:57.642011+0000","last_clean":"2026-02-13T02:41:57.642011+0000","last_became_active":"2026-02-13T02:41:49.598085+0000","last_became_peered":"2026-02-13T02:41:49.598085+0000","last_unstale":"2026-02-13T02:41:57.642011+0000","last_undegraded":"2026-02-13T02:41:57.642011+0000","last_fullsized":"2026-02-13T02:41:57.642011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:57.092957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756305+0000","last_change":"2026-02-13T02:41:50.608035+0000","last_active":"2026-02-13T02:41:51.756305+0000","last_peered":"2026-02-13T02:41:51.756305+0000","last_clean":"2026-02-13T02:41:51.756305+0000","last_became_active":"2026-02-13T02:41:50.607792+0000","last_became_peered":"2026-02-13T02:41:50.607792+0000","last_unstale":"2026-02-13T02:41:51.756305+0000","last_undegraded":"2026-02-13T02:41:51.756305+0000","last_fullsized":"2026-02-13T02:41:51.756305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:54.002715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:05.037710+0000","last_change":"2026-02-13T02:41:49.607784+0000","last_active":"2026-02-13T02:42:05.037710+0000","last_peered":"2026-02-13T02:42:05.037710+0000","last_clean":"2026-02-13T02:42:05.037710+0000","last_became_active":"2026-02-13T02:41:49.607602+0000","last_became_peered":"2026-02-13T02:41:49.607602+0000","last_unstale":"2026-02-13T02:42:05.037710+0000","last_undegraded":"2026-02-13T02:42:05.037710+0000","last_fullsized":"2026-02-13T02:42:05.037710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:36.215383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597453+0000","last_change":"2026-02-13T02:41:50.607352+0000","last_active":"2026-02-13T02:41:51.597453+0000","last_peered":"2026-02-13T02:41:51.597453+0000","last_clean":"2026-02-13T02:41:51.597453+0000","last_became_active":"2026-02-13T02:41:50.607212+0000","last_became_peered":"2026-02-13T02:41:50.607212+0000","last_unstale":"2026-02-13T02:41:51.597453+0000","last_undegraded":"2026-02-13T02:41:51.597453+0000","last_fullsized":"2026-02-13T02:41:51.597453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:52.063018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643960+0000","last_change":"2026-02-13T02:41:49.600639+0000","last_active":"2026-02-13T02:41:57.643960+0000","last_peered":"2026-02-13T02:41:57.643960+0000","last_clean":"2026-02-13T02:41:57.643960+0000","last_became_active":"2026-02-13T02:41:49.600493+0000","last_became_peered":"2026-02-13T02:41:49.600493+0000","last_unstale":"2026-02-13T02:41:57.643960+0000","last_undegraded":"2026-02-13T02:41:57.643960+0000","last_fullsized":"2026-02-13T02:41:57.643960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:49:51.847533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756691+0000","last_change":"2026-02-13T02:41:50.608701+0000","last_active":"2026-02-13T02:41:51.756691+0000","last_peered":"2026-02-13T02:41:51.756691+0000","last_clean":"2026-02-13T02:41:51.756691+0000","last_became_active":"2026-02-13T02:41:50.608587+0000","last_became_peered":"2026-02-13T02:41:50.608587+0000","last_unstale":"2026-02-13T02:41:51.756691+0000","last_undegraded":"2026-02-13T02:41:51.756691+0000","last_fullsized":"2026-02-13T02:41:51.756691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:51.204751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.623861+0000","last_change":"2026-02-13T02:41:49.603944+0000","last_active":"2026-02-13T02:41:54.623861+0000","last_peered":"2026-02-13T02:41:54.623861+0000","last_clean":"2026-02-13T02:41:54.623861+0000","last_became_active":"2026-02-13T02:41:49.603771+0000","last_became_peered":"2026-02-13T02:41:49.603771+0000","last_unstale":"2026-02-13T02:41:54.623861+0000","last_undegraded":"2026-02-13T02:41:54.623861+0000","last_fullsized":"2026-02-13T02:41:54.623861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:02.938077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638571+0000","last_change":"2026-02-13T02:41:50.600369+0000","last_active":"2026-02-13T02:41:51.638571+0000","last_peered":"2026-02-13T02:41:51.638571+0000","last_clean":"2026-02-13T02:41:51.638571+0000","last_became_active":"2026-02-13T02:41:50.600236+0000","last_became_peered":"2026-02-13T02:41:50.600236+0000","last_unstale":"2026-02-13T02:41:51.638571+0000","last_undegraded":"2026-02-13T02:41:51.638571+0000","last_fullsized":"2026-02-13T02:41:51.638571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:33.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.644249+0000","last_change":"2026-02-13T02:41:49.606756+0000","last_active":"2026-02-13T02:41:57.644249+0000","last_peered":"2026-02-13T02:41:57.644249+0000","last_clean":"2026-02-13T02:41:57.644249+0000","last_became_active":"2026-02-13T02:41:49.606577+0000","last_became_peered":"2026-02-13T02:41:49.606577+0000","last_unstale":"2026-02-13T02:41:57.644249+0000","last_undegraded":"2026-02-13T02:41:57.644249+0000","last_fullsized":"2026-02-13T02:41:57.644249+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:22.336094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753650+0000","last_change":"2026-02-13T02:41:50.596967+0000","last_active":"2026-02-13T02:41:51.753650+0000","last_peered":"2026-02-13T02:41:51.753650+0000","last_clean":"2026-02-13T02:41:51.753650+0000","last_became_active":"2026-02-13T02:41:50.596798+0000","last_became_peered":"2026-02-13T02:41:50.596798+0000","last_unstale":"2026-02-13T02:41:51.753650+0000","last_undegraded":"2026-02-13T02:41:51.753650+0000","last_fullsized":"2026-02-13T02:41:51.753650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:46.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.633081+0000","last_change":"2026-02-13T02:41:49.605314+0000","last_active":"2026-02-13T02:41:56.633081+0000","last_peered":"2026-02-13T02:41:56.633081+0000","last_clean":"2026-02-13T02:41:56.633081+0000","last_became_active":"2026-02-13T02:41:49.605183+0000","last_became_peered":"2026-02-13T02:41:49.605183+0000","last_unstale":"2026-02-13T02:41:56.633081+0000","last_undegraded":"2026-02-13T02:41:56.633081+0000","last_fullsized":"2026-02-13T02:41:56.633081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:55.197111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597243+0000","last_change":"2026-02-13T02:41:50.605693+0000","last_active":"2026-02-13T02:41:51.597243+0000","last_peered":"2026-02-13T02:41:51.597243+0000","last_clean":"2026-02-13T02:41:51.597243+0000","last_became_active":"2026-02-13T02:41:50.605095+0000","last_became_peered":"2026-02-13T02:41:50.605095+0000","last_unstale":"2026-02-13T02:41:51.597243+0000","last_undegraded":"2026-02-13T02:41:51.597243+0000","last_fullsized":"2026-02-13T02:41:51.597243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:20.729194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.620279+0000","last_change":"2026-02-13T02:41:49.597243+0000","last_active":"2026-02-13T02:41:54.620279+0000","last_peered":"2026-02-13T02:41:54.620279+0000","last_clean":"2026-02-13T02:41:54.620279+0000","last_became_active":"2026-02-13T02:41:49.596866+0000","last_became_peered":"2026-02-13T02:41:49.596866+0000","last_unstale":"2026-02-13T02:41:54.620279+0000","last_undegraded":"2026-02-13T02:41:54.620279+0000","last_fullsized":"2026-02-13T02:41:54.620279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:29:38.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686068+0000","last_change":"2026-02-13T02:41:50.606794+0000","last_active":"2026-02-13T02:41:51.686068+0000","last_peered":"2026-02-13T02:41:51.686068+0000","last_clean":"2026-02-13T02:41:51.686068+0000","last_became_active":"2026-02-13T02:41:50.606595+0000","last_became_peered":"2026-02-13T02:41:50.606595+0000","last_unstale":"2026-02-13T02:41:51.686068+0000","last_undegraded":"2026-02-13T02:41:51.686068+0000","last_fullsized":"2026-02-13T02:41:51.686068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:24.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594579+0000","last_change":"2026-02-13T02:41:50.602019+0000","last_active":"2026-02-13T02:41:51.594579+0000","last_peered":"2026-02-13T02:41:51.594579+0000","last_clean":"2026-02-13T02:41:51.594579+0000","last_became_active":"2026-02-13T02:41:50.601731+0000","last_became_peered":"2026-02-13T02:41:50.601731+0000","last_unstale":"2026-02-13T02:41:51.594579+0000","last_undegraded":"2026-02-13T02:41:51.594579+0000","last_fullsized":"2026-02-13T02:41:51.594579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:19.211804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639877+0000","last_change":"2026-02-13T02:41:49.596759+0000","last_active":"2026-02-13T02:41:57.639877+0000","last_peered":"2026-02-13T02:41:57.639877+0000","last_clean":"2026-02-13T02:41:57.639877+0000","last_became_active":"2026-02-13T02:41:49.596314+0000","last_became_peered":"2026-02-13T02:41:49.596314+0000","last_unstale":"2026-02-13T02:41:57.639877+0000","last_undegraded":"2026-02-13T02:41:57.639877+0000","last_fullsized":"2026-02-13T02:41:57.639877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:20:20.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756768+0000","last_change":"2026-02-13T02:41:50.605832+0000","last_active":"2026-02-13T02:41:51.756768+0000","last_peered":"2026-02-13T02:41:51.756768+0000","last_clean":"2026-02-13T02:41:51.756768+0000","last_became_active":"2026-02-13T02:41:50.605574+0000","last_became_peered":"2026-02-13T02:41:50.605574+0000","last_unstale":"2026-02-13T02:41:51.756768+0000","last_undegraded":"2026-02-13T02:41:51.756768+0000","last_fullsized":"2026-02-13T02:41:51.756768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:33:32.847010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.638633+0000","last_change":"2026-02-13T02:41:49.596987+0000","last_active":"2026-02-13T02:41:58.638633+0000","last_peered":"2026-02-13T02:41:58.638633+0000","last_clean":"2026-02-13T02:41:58.638633+0000","last_became_active":"2026-02-13T02:41:49.596599+0000","last_became_peered":"2026-02-13T02:41:49.596599+0000","last_unstale":"2026-02-13T02:41:58.638633+0000","last_undegraded":"2026-02-13T02:41:58.638633+0000","last_fullsized":"2026-02-13T02:41:58.638633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:30.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756702+0000","last_change":"2026-02-13T02:41:50.610429+0000","last_active":"2026-02-13T02:41:51.756702+0000","last_peered":"2026-02-13T02:41:51.756702+0000","last_clean":"2026-02-13T02:41:51.756702+0000","last_became_active":"2026-02-13T02:41:50.610239+0000","last_became_peered":"2026-02-13T02:41:50.610239+0000","last_unstale":"2026-02-13T02:41:51.756702+0000","last_undegraded":"2026-02-13T02:41:51.756702+0000","last_fullsized":"2026-02-13T02:41:51.756702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:40.272140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:52.062405+0000","last_change":"2026-02-13T02:41:49.606193+0000","last_active":"2026-02-13T02:41:52.062405+0000","last_peered":"2026-02-13T02:41:52.062405+0000","last_clean":"2026-02-13T02:41:52.062405+0000","last_became_active":"2026-02-13T02:41:49.606085+0000","last_became_peered":"2026-02-13T02:41:49.606085+0000","last_unstale":"2026-02-13T02:41:52.062405+0000","last_undegraded":"2026-02-13T02:41:52.062405+0000","last_fullsized":"2026-02-13T02:41:52.062405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:49:14.551780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597364+0000","last_change":"2026-02-13T02:41:50.608679+0000","last_active":"2026-02-13T02:41:51.597364+0000","last_peered":"2026-02-13T02:41:51.597364+0000","last_clean":"2026-02-13T02:41:51.597364+0000","last_became_active":"2026-02-13T02:41:50.607474+0000","last_became_peered":"2026-02-13T02:41:50.607474+0000","last_unstale":"2026-02-13T02:41:51.597364+0000","last_undegraded":"2026-02-13T02:41:51.597364+0000","last_fullsized":"2026-02-13T02:41:51.597364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:49:25.463410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:07.652885+0000","last_change":"2026-02-13T02:41:49.599289+0000","last_active":"2026-02-13T02:42:07.652885+0000","last_peered":"2026-02-13T02:42:07.652885+0000","last_clean":"2026-02-13T02:42:07.652885+0000","last_became_active":"2026-02-13T02:41:49.598567+0000","last_became_peered":"2026-02-13T02:41:49.598567+0000","last_unstale":"2026-02-13T02:42:07.652885+0000","last_undegraded":"2026-02-13T02:42:07.652885+0000","last_fullsized":"2026-02-13T02:42:07.652885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:23.527572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69850,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":129,"num_read_kb":141,"num_write":236,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":302672,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264489,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710730,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":399099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939659,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27924,"kb_used_data":960,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975276,"statfs":{"total":751619276800,"available":751590682624,"internally_reserved":0,"allocated":983040,"data_stored":1052216,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33581,"internal_metadata":27557075},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103182,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":398619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33874,"internal_metadata":27556782},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332112,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":399019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34076,"internal_metadata":27556580},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":991966,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34554,"internal_metadata":27556102},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":398314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34870,"internal_metadata":27555786},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920788,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":991256,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33490,"internal_metadata":27557166},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051606,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":398585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43851,"internal_metadata":27546805},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280536,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":398139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47978,"internal_metadata":27542678},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27860,"kb_used_data":896,"kb_used_omap":58,"kb_used_meta":26885,"kb_avail":733975340,"statfs":{"total":751619276800,"available":751590748160,"internally_reserved":0,"allocated":917504,"data_stored":462377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60241,"internal_metadata":27530415},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27840,"kb_used_data":876,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975360,"statfs":{"total":751619276800,"available":751590768640,"internally_reserved":0,"allocated":897024,"data_stored":461359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45723,"internal_metadata":27544933},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":400107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50354,"internal_metadata":27540302},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11364,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2724,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58647,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46386,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26177,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9904,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11905,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32965,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32379,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32275,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31982,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5964,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:42:10.188 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:42:10.368 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:10.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 -- 10.20.193.78:0/2827087038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410fbf0 msgr2=0x7f6174114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:10.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 --2- 10.20.193.78:0/2827087038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410fbf0 0x7f6174114c30 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=12965902614971944054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61680099a0 tx=0x7f616802ed00 comp rx=0 tx=0).stop 2026-02-13T02:42:10.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 -- 10.20.193.78:0/2827087038 shutdown_connections 2026-02-13T02:42:10.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 --2- 10.20.193.78:0/2827087038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6174115410 0x7f6174175db0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 --2- 10.20.193.78:0/2827087038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410fbf0 0x7f6174114c30 unknown :-1 s=CLOSED pgs=114 gs=3 cs=0 l=1 c_cookie=12965902614971944054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 --2- 10.20.193.78:0/2827087038 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f617410f200 0x7f617410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 -- 10.20.193.78:0/2827087038 >> 10.20.193.78:0/2827087038 conn(0x7f61740ecb00 msgr2=0x7f617410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:10.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 -- 10.20.193.78:0/2827087038 shutdown_connections 2026-02-13T02:42:10.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.553+0000 7f617c4086c0 1 -- 10.20.193.78:0/2827087038 wait complete. 2026-02-13T02:42:10.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 Processor -- start 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 -- start start 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410f200 0x7f61740f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6174115410 0x7f6174175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61740f5140 0x7f61740fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f61740f5830 con 0x7f6174115410 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f61740fa950 con 0x7f61740f5140 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617c4086c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61740fab10 con 0x7f617410f200 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617a97a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61740f5140 0x7f61740fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:10.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617a97a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61740f5140 0x7f61740fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60640/0 (socket says 10.20.193.78:60640) 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617a97a6c0 1 -- 10.20.193.78:0/1428804461 learned_addr learned my addr 10.20.193.78:0/1428804461 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617a1796c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410f200 0x7f61740f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f61799786c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6174115410 0x7f6174175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.554+0000 7f617a97a6c0 1 -- 10.20.193.78:0/1428804461 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410f200 msgr2=0x7f61740f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617a97a6c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410f200 0x7f61740f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617a97a6c0 1 -- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6174115410 msgr2=0x7f6174175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617a97a6c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6174115410 0x7f6174175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617a97a6c0 1 -- 10.20.193.78:0/1428804461 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6168009590 con 0x7f61740f5140 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617a97a6c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61740f5140 0x7f61740fa410 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617000c9b0 tx=0x7f617000ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f615b7fe6c0 1 -- 10.20.193.78:0/1428804461 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6170003c40 con 0x7f61740f5140 2026-02-13T02:42:10.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f615b7fe6c0 1 -- 10.20.193.78:0/1428804461 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6170003da0 con 0x7f61740f5140 2026-02-13T02:42:10.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f615b7fe6c0 1 -- 10.20.193.78:0/1428804461 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61700081c0 con 0x7f61740f5140 2026-02-13T02:42:10.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61740fadf0 con 0x7f61740f5140 2026-02-13T02:42:10.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61740fb580 con 0x7f61740f5140 2026-02-13T02:42:10.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.555+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61740fb2d0 con 0x7f61740f5140 2026-02-13T02:42:10.560 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.557+0000 7f615b7fe6c0 1 -- 10.20.193.78:0/1428804461 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f617000d5c0 con 0x7f61740f5140 2026-02-13T02:42:10.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.559+0000 7f615b7fe6c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f61500b5760 0x7f61500d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:10.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.559+0000 7f615b7fe6c0 1 -- 10.20.193.78:0/1428804461 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f61700e4ba0 con 0x7f61740f5140 2026-02-13T02:42:10.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.559+0000 7f615b7fe6c0 1 -- 10.20.193.78:0/1428804461 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f617011d600 con 0x7f61740f5140 2026-02-13T02:42:10.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.559+0000 7f617a1796c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f61500b5760 0x7f61500d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:10.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.560+0000 7f617a1796c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f61500b5760 0x7f61500d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6164004750 tx=0x7f6164009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:10.660 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.658+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 --> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61740f5c60 con 0x7f61500b5760 2026-02-13T02:42:10.662 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.660+0000 7f615b7fe6c0 1 -- 10.20.193.78:0/1428804461 <== mgr.14187 v2:10.20.193.78:6800/1569498056 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259011 (secure 0 0 0) 0x7f61740f5c60 con 0x7f61500b5760 2026-02-13T02:42:10.665 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:10.667 INFO:teuthology.orchestra.run.trial078.stderr:dumped all 2026-02-13T02:42:10.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f61500b5760 msgr2=0x7f61500d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:10.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f61500b5760 0x7f61500d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6164004750 tx=0x7f6164009260 comp rx=0 tx=0).stop 2026-02-13T02:42:10.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61740f5140 msgr2=0x7f61740fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:10.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61740f5140 0x7f61740fa410 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617000c9b0 tx=0x7f617000ce80 comp rx=0 tx=0).stop 2026-02-13T02:42:10.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 shutdown_connections 2026-02-13T02:42:10.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f61500b5760 0x7f61500d5c10 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61740f5140 0x7f61740fa410 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6174115410 0x7f6174175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 --2- 10.20.193.78:0/1428804461 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f617410f200 0x7f61740f4b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:10.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 >> 10.20.193.78:0/1428804461 conn(0x7f61740ecb00 msgr2=0x7f6174113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:10.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 shutdown_connections 2026-02-13T02:42:10.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:10.663+0000 7f617c4086c0 1 -- 10.20.193.78:0/1428804461 wait complete. 2026-02-13T02:42:10.770 INFO:teuthology.orchestra.run.trial078.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-13T02:42:09.623687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660452,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":243,"num_read_kb":240,"num_write":427,"num_write_kb":3859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":359,"ondisk_log_size":359,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333840,"kb_used_data":10272,"kb_used_omap":451,"kb_used_meta":322876,"kb_avail":8807704560,"statfs":{"total":9019431321600,"available":9019089469440,"internally_reserved":0,"allocated":10518528,"data_stored":6751056,"data_compressed":114759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":462058,"internal_metadata":330625814},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64214,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":129,"num_read_kb":141,"num_write":143,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003149"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753798+0000","last_change":"2026-02-13T02:41:50.599914+0000","last_active":"2026-02-13T02:41:51.753798+0000","last_peered":"2026-02-13T02:41:51.753798+0000","last_clean":"2026-02-13T02:41:51.753798+0000","last_became_active":"2026-02-13T02:41:50.599730+0000","last_became_peered":"2026-02-13T02:41:50.599730+0000","last_unstale":"2026-02-13T02:41:51.753798+0000","last_undegraded":"2026-02-13T02:41:51.753798+0000","last_fullsized":"2026-02-13T02:41:51.753798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:03:13.109709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756660+0000","last_change":"2026-02-13T02:41:50.600052+0000","last_active":"2026-02-13T02:41:51.756660+0000","last_peered":"2026-02-13T02:41:51.756660+0000","last_clean":"2026-02-13T02:41:51.756660+0000","last_became_active":"2026-02-13T02:41:50.599602+0000","last_became_peered":"2026-02-13T02:41:50.599602+0000","last_unstale":"2026-02-13T02:41:51.756660+0000","last_undegraded":"2026-02-13T02:41:51.756660+0000","last_fullsized":"2026-02-13T02:41:51.756660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:46:52.030776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756493+0000","last_change":"2026-02-13T02:41:50.603536+0000","last_active":"2026-02-13T02:41:51.756493+0000","last_peered":"2026-02-13T02:41:51.756493+0000","last_clean":"2026-02-13T02:41:51.756493+0000","last_became_active":"2026-02-13T02:41:50.603397+0000","last_became_peered":"2026-02-13T02:41:50.603397+0000","last_unstale":"2026-02-13T02:41:51.756493+0000","last_undegraded":"2026-02-13T02:41:51.756493+0000","last_fullsized":"2026-02-13T02:41:51.756493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:43:53.008982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.757018+0000","last_change":"2026-02-13T02:41:50.605058+0000","last_active":"2026-02-13T02:41:51.757018+0000","last_peered":"2026-02-13T02:41:51.757018+0000","last_clean":"2026-02-13T02:41:51.757018+0000","last_became_active":"2026-02-13T02:41:50.604762+0000","last_became_peered":"2026-02-13T02:41:50.604762+0000","last_unstale":"2026-02-13T02:41:51.757018+0000","last_undegraded":"2026-02-13T02:41:51.757018+0000","last_fullsized":"2026-02-13T02:41:51.757018+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:30:25.425794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638592+0000","last_change":"2026-02-13T02:41:50.603698+0000","last_active":"2026-02-13T02:41:51.638592+0000","last_peered":"2026-02-13T02:41:51.638592+0000","last_clean":"2026-02-13T02:41:51.638592+0000","last_became_active":"2026-02-13T02:41:50.603555+0000","last_became_peered":"2026-02-13T02:41:50.603555+0000","last_unstale":"2026-02-13T02:41:51.638592+0000","last_undegraded":"2026-02-13T02:41:51.638592+0000","last_fullsized":"2026-02-13T02:41:51.638592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:05.519511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598097+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.598097+0000","last_peered":"2026-02-13T02:41:51.598097+0000","last_clean":"2026-02-13T02:41:51.598097+0000","last_became_active":"2026-02-13T02:41:50.607050+0000","last_became_peered":"2026-02-13T02:41:50.607050+0000","last_unstale":"2026-02-13T02:41:51.598097+0000","last_undegraded":"2026-02-13T02:41:51.598097+0000","last_fullsized":"2026-02-13T02:41:51.598097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:36.348221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685915+0000","last_change":"2026-02-13T02:41:50.607186+0000","last_active":"2026-02-13T02:41:51.685915+0000","last_peered":"2026-02-13T02:41:51.685915+0000","last_clean":"2026-02-13T02:41:51.685915+0000","last_became_active":"2026-02-13T02:41:50.607052+0000","last_became_peered":"2026-02-13T02:41:50.607052+0000","last_unstale":"2026-02-13T02:41:51.685915+0000","last_undegraded":"2026-02-13T02:41:51.685915+0000","last_fullsized":"2026-02-13T02:41:51.685915+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:09.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596911+0000","last_change":"2026-02-13T02:41:50.606858+0000","last_active":"2026-02-13T02:41:51.596911+0000","last_peered":"2026-02-13T02:41:51.596911+0000","last_clean":"2026-02-13T02:41:51.596911+0000","last_became_active":"2026-02-13T02:41:50.606045+0000","last_became_peered":"2026-02-13T02:41:50.606045+0000","last_unstale":"2026-02-13T02:41:51.596911+0000","last_undegraded":"2026-02-13T02:41:51.596911+0000","last_fullsized":"2026-02-13T02:41:51.596911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:19:05.276035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756934+0000","last_change":"2026-02-13T02:41:50.604103+0000","last_active":"2026-02-13T02:41:51.756934+0000","last_peered":"2026-02-13T02:41:51.756934+0000","last_clean":"2026-02-13T02:41:51.756934+0000","last_became_active":"2026-02-13T02:41:50.603863+0000","last_became_peered":"2026-02-13T02:41:50.603863+0000","last_unstale":"2026-02-13T02:41:51.756934+0000","last_undegraded":"2026-02-13T02:41:51.756934+0000","last_fullsized":"2026-02-13T02:41:51.756934+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:35:13.220919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598569+0000","last_change":"2026-02-13T02:41:50.604086+0000","last_active":"2026-02-13T02:41:51.598569+0000","last_peered":"2026-02-13T02:41:51.598569+0000","last_clean":"2026-02-13T02:41:51.598569+0000","last_became_active":"2026-02-13T02:41:50.603680+0000","last_became_peered":"2026-02-13T02:41:50.603680+0000","last_unstale":"2026-02-13T02:41:51.598569+0000","last_undegraded":"2026-02-13T02:41:51.598569+0000","last_fullsized":"2026-02-13T02:41:51.598569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:24:37.164379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686176+0000","last_change":"2026-02-13T02:41:50.605319+0000","last_active":"2026-02-13T02:41:51.686176+0000","last_peered":"2026-02-13T02:41:51.686176+0000","last_clean":"2026-02-13T02:41:51.686176+0000","last_became_active":"2026-02-13T02:41:50.605054+0000","last_became_peered":"2026-02-13T02:41:50.605054+0000","last_unstale":"2026-02-13T02:41:51.686176+0000","last_undegraded":"2026-02-13T02:41:51.686176+0000","last_fullsized":"2026-02-13T02:41:51.686176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:25:10.690555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756968+0000","last_change":"2026-02-13T02:41:50.604779+0000","last_active":"2026-02-13T02:41:51.756968+0000","last_peered":"2026-02-13T02:41:51.756968+0000","last_clean":"2026-02-13T02:41:51.756968+0000","last_became_active":"2026-02-13T02:41:50.604459+0000","last_became_peered":"2026-02-13T02:41:50.604459+0000","last_unstale":"2026-02-13T02:41:51.756968+0000","last_undegraded":"2026-02-13T02:41:51.756968+0000","last_fullsized":"2026-02-13T02:41:51.756968+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:56:44.125622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756288+0000","last_change":"2026-02-13T02:41:50.605422+0000","last_active":"2026-02-13T02:41:51.756288+0000","last_peered":"2026-02-13T02:41:51.756288+0000","last_clean":"2026-02-13T02:41:51.756288+0000","last_became_active":"2026-02-13T02:41:50.605329+0000","last_became_peered":"2026-02-13T02:41:50.605329+0000","last_unstale":"2026-02-13T02:41:51.756288+0000","last_undegraded":"2026-02-13T02:41:51.756288+0000","last_fullsized":"2026-02-13T02:41:51.756288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:16.056010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755988+0000","last_change":"2026-02-13T02:41:50.602168+0000","last_active":"2026-02-13T02:41:51.755988+0000","last_peered":"2026-02-13T02:41:51.755988+0000","last_clean":"2026-02-13T02:41:51.755988+0000","last_became_active":"2026-02-13T02:41:50.601828+0000","last_became_peered":"2026-02-13T02:41:50.601828+0000","last_unstale":"2026-02-13T02:41:51.755988+0000","last_undegraded":"2026-02-13T02:41:51.755988+0000","last_fullsized":"2026-02-13T02:41:51.755988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:15:44.301005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756057+0000","last_change":"2026-02-13T02:41:50.603578+0000","last_active":"2026-02-13T02:41:51.756057+0000","last_peered":"2026-02-13T02:41:51.756057+0000","last_clean":"2026-02-13T02:41:51.756057+0000","last_became_active":"2026-02-13T02:41:50.603419+0000","last_became_peered":"2026-02-13T02:41:50.603419+0000","last_unstale":"2026-02-13T02:41:51.756057+0000","last_undegraded":"2026-02-13T02:41:51.756057+0000","last_fullsized":"2026-02-13T02:41:51.756057+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:51:21.276131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756604+0000","last_change":"2026-02-13T02:41:50.604104+0000","last_active":"2026-02-13T02:41:51.756604+0000","last_peered":"2026-02-13T02:41:51.756604+0000","last_clean":"2026-02-13T02:41:51.756604+0000","last_became_active":"2026-02-13T02:41:50.603842+0000","last_became_peered":"2026-02-13T02:41:50.603842+0000","last_unstale":"2026-02-13T02:41:51.756604+0000","last_undegraded":"2026-02-13T02:41:51.756604+0000","last_fullsized":"2026-02-13T02:41:51.756604+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:39:14.046728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753888+0000","last_change":"2026-02-13T02:41:50.600064+0000","last_active":"2026-02-13T02:41:51.753888+0000","last_peered":"2026-02-13T02:41:51.753888+0000","last_clean":"2026-02-13T02:41:51.753888+0000","last_became_active":"2026-02-13T02:41:50.599816+0000","last_became_peered":"2026-02-13T02:41:50.599816+0000","last_unstale":"2026-02-13T02:41:51.753888+0000","last_undegraded":"2026-02-13T02:41:51.753888+0000","last_fullsized":"2026-02-13T02:41:51.753888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:21.509074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756002+0000","last_change":"2026-02-13T02:41:50.603623+0000","last_active":"2026-02-13T02:41:51.756002+0000","last_peered":"2026-02-13T02:41:51.756002+0000","last_clean":"2026-02-13T02:41:51.756002+0000","last_became_active":"2026-02-13T02:41:50.603557+0000","last_became_peered":"2026-02-13T02:41:50.603557+0000","last_unstale":"2026-02-13T02:41:51.756002+0000","last_undegraded":"2026-02-13T02:41:51.756002+0000","last_fullsized":"2026-02-13T02:41:51.756002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:06:43.142827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594535+0000","last_change":"2026-02-13T02:41:50.604758+0000","last_active":"2026-02-13T02:41:51.594535+0000","last_peered":"2026-02-13T02:41:51.594535+0000","last_clean":"2026-02-13T02:41:51.594535+0000","last_became_active":"2026-02-13T02:41:50.604617+0000","last_became_peered":"2026-02-13T02:41:50.604617+0000","last_unstale":"2026-02-13T02:41:51.594535+0000","last_undegraded":"2026-02-13T02:41:51.594535+0000","last_fullsized":"2026-02-13T02:41:51.594535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:50.763524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753576+0000","last_change":"2026-02-13T02:41:50.601097+0000","last_active":"2026-02-13T02:41:51.753576+0000","last_peered":"2026-02-13T02:41:51.753576+0000","last_clean":"2026-02-13T02:41:51.753576+0000","last_became_active":"2026-02-13T02:41:50.600904+0000","last_became_peered":"2026-02-13T02:41:50.600904+0000","last_unstale":"2026-02-13T02:41:51.753576+0000","last_undegraded":"2026-02-13T02:41:51.753576+0000","last_fullsized":"2026-02-13T02:41:51.753576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:28:11.088460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756282+0000","last_change":"2026-02-13T02:41:50.610769+0000","last_active":"2026-02-13T02:41:51.756282+0000","last_peered":"2026-02-13T02:41:51.756282+0000","last_clean":"2026-02-13T02:41:51.756282+0000","last_became_active":"2026-02-13T02:41:50.610617+0000","last_became_peered":"2026-02-13T02:41:50.610617+0000","last_unstale":"2026-02-13T02:41:51.756282+0000","last_undegraded":"2026-02-13T02:41:51.756282+0000","last_fullsized":"2026-02-13T02:41:51.756282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:46.547410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756657+0000","last_change":"2026-02-13T02:41:50.607490+0000","last_active":"2026-02-13T02:41:51.756657+0000","last_peered":"2026-02-13T02:41:51.756657+0000","last_clean":"2026-02-13T02:41:51.756657+0000","last_became_active":"2026-02-13T02:41:50.607298+0000","last_became_peered":"2026-02-13T02:41:50.607298+0000","last_unstale":"2026-02-13T02:41:51.756657+0000","last_undegraded":"2026-02-13T02:41:51.756657+0000","last_fullsized":"2026-02-13T02:41:51.756657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:07.720966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596921+0000","last_change":"2026-02-13T02:41:50.606974+0000","last_active":"2026-02-13T02:41:51.596921+0000","last_peered":"2026-02-13T02:41:51.596921+0000","last_clean":"2026-02-13T02:41:51.596921+0000","last_became_active":"2026-02-13T02:41:50.606344+0000","last_became_peered":"2026-02-13T02:41:50.606344+0000","last_unstale":"2026-02-13T02:41:51.596921+0000","last_undegraded":"2026-02-13T02:41:51.596921+0000","last_fullsized":"2026-02-13T02:41:51.596921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:12.593325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594547+0000","last_change":"2026-02-13T02:41:50.605952+0000","last_active":"2026-02-13T02:41:51.594547+0000","last_peered":"2026-02-13T02:41:51.594547+0000","last_clean":"2026-02-13T02:41:51.594547+0000","last_became_active":"2026-02-13T02:41:50.605843+0000","last_became_peered":"2026-02-13T02:41:50.605843+0000","last_unstale":"2026-02-13T02:41:51.594547+0000","last_undegraded":"2026-02-13T02:41:51.594547+0000","last_fullsized":"2026-02-13T02:41:51.594547+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:43:56.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597412+0000","last_change":"2026-02-13T02:41:50.607967+0000","last_active":"2026-02-13T02:41:51.597412+0000","last_peered":"2026-02-13T02:41:51.597412+0000","last_clean":"2026-02-13T02:41:51.597412+0000","last_became_active":"2026-02-13T02:41:50.607467+0000","last_became_peered":"2026-02-13T02:41:50.607467+0000","last_unstale":"2026-02-13T02:41:51.597412+0000","last_undegraded":"2026-02-13T02:41:51.597412+0000","last_fullsized":"2026-02-13T02:41:51.597412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:58:02.579210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594625+0000","last_change":"2026-02-13T02:41:50.599821+0000","last_active":"2026-02-13T02:41:51.594625+0000","last_peered":"2026-02-13T02:41:51.594625+0000","last_clean":"2026-02-13T02:41:51.594625+0000","last_became_active":"2026-02-13T02:41:50.599654+0000","last_became_peered":"2026-02-13T02:41:50.599654+0000","last_unstale":"2026-02-13T02:41:51.594625+0000","last_undegraded":"2026-02-13T02:41:51.594625+0000","last_fullsized":"2026-02-13T02:41:51.594625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:32:20.138295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753717+0000","last_change":"2026-02-13T02:41:50.600422+0000","last_active":"2026-02-13T02:41:51.753717+0000","last_peered":"2026-02-13T02:41:51.753717+0000","last_clean":"2026-02-13T02:41:51.753717+0000","last_became_active":"2026-02-13T02:41:50.600118+0000","last_became_peered":"2026-02-13T02:41:50.600118+0000","last_unstale":"2026-02-13T02:41:51.753717+0000","last_undegraded":"2026-02-13T02:41:51.753717+0000","last_fullsized":"2026-02-13T02:41:51.753717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:18:51.209188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756265+0000","last_change":"2026-02-13T02:41:50.611343+0000","last_active":"2026-02-13T02:41:51.756265+0000","last_peered":"2026-02-13T02:41:51.756265+0000","last_clean":"2026-02-13T02:41:51.756265+0000","last_became_active":"2026-02-13T02:41:50.611129+0000","last_became_peered":"2026-02-13T02:41:50.611129+0000","last_unstale":"2026-02-13T02:41:51.756265+0000","last_undegraded":"2026-02-13T02:41:51.756265+0000","last_fullsized":"2026-02-13T02:41:51.756265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:26.181721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756482+0000","last_change":"2026-02-13T02:41:50.610427+0000","last_active":"2026-02-13T02:41:51.756482+0000","last_peered":"2026-02-13T02:41:51.756482+0000","last_clean":"2026-02-13T02:41:51.756482+0000","last_became_active":"2026-02-13T02:41:50.609859+0000","last_became_peered":"2026-02-13T02:41:50.609859+0000","last_unstale":"2026-02-13T02:41:51.756482+0000","last_undegraded":"2026-02-13T02:41:51.756482+0000","last_fullsized":"2026-02-13T02:41:51.756482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:35:38.289372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594356+0000","last_change":"2026-02-13T02:41:50.606399+0000","last_active":"2026-02-13T02:41:51.594356+0000","last_peered":"2026-02-13T02:41:51.594356+0000","last_clean":"2026-02-13T02:41:51.594356+0000","last_became_active":"2026-02-13T02:41:50.606261+0000","last_became_peered":"2026-02-13T02:41:50.606261+0000","last_unstale":"2026-02-13T02:41:51.594356+0000","last_undegraded":"2026-02-13T02:41:51.594356+0000","last_fullsized":"2026-02-13T02:41:51.594356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:35.087843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594337+0000","last_change":"2026-02-13T02:41:50.600540+0000","last_active":"2026-02-13T02:41:51.594337+0000","last_peered":"2026-02-13T02:41:51.594337+0000","last_clean":"2026-02-13T02:41:51.594337+0000","last_became_active":"2026-02-13T02:41:50.600370+0000","last_became_peered":"2026-02-13T02:41:50.600370+0000","last_unstale":"2026-02-13T02:41:51.594337+0000","last_undegraded":"2026-02-13T02:41:51.594337+0000","last_fullsized":"2026-02-13T02:41:51.594337+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:42.274036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753590+0000","last_change":"2026-02-13T02:41:50.602084+0000","last_active":"2026-02-13T02:41:51.753590+0000","last_peered":"2026-02-13T02:41:51.753590+0000","last_clean":"2026-02-13T02:41:51.753590+0000","last_became_active":"2026-02-13T02:41:50.601938+0000","last_became_peered":"2026-02-13T02:41:50.601938+0000","last_unstale":"2026-02-13T02:41:51.753590+0000","last_undegraded":"2026-02-13T02:41:51.753590+0000","last_fullsized":"2026-02-13T02:41:51.753590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:12:44.963129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638688+0000","last_change":"2026-02-13T02:41:50.602908+0000","last_active":"2026-02-13T02:41:51.638688+0000","last_peered":"2026-02-13T02:41:51.638688+0000","last_clean":"2026-02-13T02:41:51.638688+0000","last_became_active":"2026-02-13T02:41:50.602815+0000","last_became_peered":"2026-02-13T02:41:50.602815+0000","last_unstale":"2026-02-13T02:41:51.638688+0000","last_undegraded":"2026-02-13T02:41:51.638688+0000","last_fullsized":"2026-02-13T02:41:51.638688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:51:10.405979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:05.646883+0000","last_change":"2026-02-13T02:41:49.595741+0000","last_active":"2026-02-13T02:42:05.646883+0000","last_peered":"2026-02-13T02:42:05.646883+0000","last_clean":"2026-02-13T02:42:05.646883+0000","last_became_active":"2026-02-13T02:41:49.595588+0000","last_became_peered":"2026-02-13T02:41:49.595588+0000","last_unstale":"2026-02-13T02:42:05.646883+0000","last_undegraded":"2026-02-13T02:42:05.646883+0000","last_fullsized":"2026-02-13T02:42:05.646883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:16.074126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594578+0000","last_change":"2026-02-13T02:41:50.604001+0000","last_active":"2026-02-13T02:41:51.594578+0000","last_peered":"2026-02-13T02:41:51.594578+0000","last_clean":"2026-02-13T02:41:51.594578+0000","last_became_active":"2026-02-13T02:41:50.603876+0000","last_became_peered":"2026-02-13T02:41:50.603876+0000","last_unstale":"2026-02-13T02:41:51.594578+0000","last_undegraded":"2026-02-13T02:41:51.594578+0000","last_fullsized":"2026-02-13T02:41:51.594578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:24:01.725748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.636482+0000","last_change":"2026-02-13T02:41:49.604405+0000","last_active":"2026-02-13T02:41:56.636482+0000","last_peered":"2026-02-13T02:41:56.636482+0000","last_clean":"2026-02-13T02:41:56.636482+0000","last_became_active":"2026-02-13T02:41:49.604257+0000","last_became_peered":"2026-02-13T02:41:49.604257+0000","last_unstale":"2026-02-13T02:41:56.636482+0000","last_undegraded":"2026-02-13T02:41:56.636482+0000","last_fullsized":"2026-02-13T02:41:56.636482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:45.835163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.630743+0000","last_change":"2026-02-13T02:41:49.601797+0000","last_active":"2026-02-13T02:41:55.630743+0000","last_peered":"2026-02-13T02:41:55.630743+0000","last_clean":"2026-02-13T02:41:55.630743+0000","last_became_active":"2026-02-13T02:41:49.601398+0000","last_became_peered":"2026-02-13T02:41:49.601398+0000","last_unstale":"2026-02-13T02:41:55.630743+0000","last_undegraded":"2026-02-13T02:41:55.630743+0000","last_fullsized":"2026-02-13T02:41:55.630743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:37.346955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.596989+0000","last_change":"2026-02-13T02:41:50.606972+0000","last_active":"2026-02-13T02:41:51.596989+0000","last_peered":"2026-02-13T02:41:51.596989+0000","last_clean":"2026-02-13T02:41:51.596989+0000","last_became_active":"2026-02-13T02:41:50.606736+0000","last_became_peered":"2026-02-13T02:41:50.606736+0000","last_unstale":"2026-02-13T02:41:51.596989+0000","last_undegraded":"2026-02-13T02:41:51.596989+0000","last_fullsized":"2026-02-13T02:41:51.596989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:35:46.423039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639593+0000","last_change":"2026-02-13T02:41:49.595837+0000","last_active":"2026-02-13T02:41:57.639593+0000","last_peered":"2026-02-13T02:41:57.639593+0000","last_clean":"2026-02-13T02:41:57.639593+0000","last_became_active":"2026-02-13T02:41:49.595704+0000","last_became_peered":"2026-02-13T02:41:49.595704+0000","last_unstale":"2026-02-13T02:41:57.639593+0000","last_undegraded":"2026-02-13T02:41:57.639593+0000","last_fullsized":"2026-02-13T02:41:57.639593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:01:23.763609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756049+0000","last_change":"2026-02-13T02:41:50.611914+0000","last_active":"2026-02-13T02:41:51.756049+0000","last_peered":"2026-02-13T02:41:51.756049+0000","last_clean":"2026-02-13T02:41:51.756049+0000","last_became_active":"2026-02-13T02:41:50.611636+0000","last_became_peered":"2026-02-13T02:41:50.611636+0000","last_unstale":"2026-02-13T02:41:51.756049+0000","last_undegraded":"2026-02-13T02:41:51.756049+0000","last_fullsized":"2026-02-13T02:41:51.756049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:52:16.098346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:06.650455+0000","last_change":"2026-02-13T02:41:49.601592+0000","last_active":"2026-02-13T02:42:06.650455+0000","last_peered":"2026-02-13T02:42:06.650455+0000","last_clean":"2026-02-13T02:42:06.650455+0000","last_became_active":"2026-02-13T02:41:49.601466+0000","last_became_peered":"2026-02-13T02:41:49.601466+0000","last_unstale":"2026-02-13T02:42:06.650455+0000","last_undegraded":"2026-02-13T02:42:06.650455+0000","last_fullsized":"2026-02-13T02:42:06.650455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:54.238406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756898+0000","last_change":"2026-02-13T02:41:50.605957+0000","last_active":"2026-02-13T02:41:51.756898+0000","last_peered":"2026-02-13T02:41:51.756898+0000","last_clean":"2026-02-13T02:41:51.756898+0000","last_became_active":"2026-02-13T02:41:50.605827+0000","last_became_peered":"2026-02-13T02:41:50.605827+0000","last_unstale":"2026-02-13T02:41:51.756898+0000","last_undegraded":"2026-02-13T02:41:51.756898+0000","last_fullsized":"2026-02-13T02:41:51.756898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:29.966443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643085+0000","last_change":"2026-02-13T02:41:49.599890+0000","last_active":"2026-02-13T02:41:57.643085+0000","last_peered":"2026-02-13T02:41:57.643085+0000","last_clean":"2026-02-13T02:41:57.643085+0000","last_became_active":"2026-02-13T02:41:49.599626+0000","last_became_peered":"2026-02-13T02:41:49.599626+0000","last_unstale":"2026-02-13T02:41:57.643085+0000","last_undegraded":"2026-02-13T02:41:57.643085+0000","last_fullsized":"2026-02-13T02:41:57.643085+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:27:44.242839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756712+0000","last_change":"2026-02-13T02:41:50.608740+0000","last_active":"2026-02-13T02:41:51.756712+0000","last_peered":"2026-02-13T02:41:51.756712+0000","last_clean":"2026-02-13T02:41:51.756712+0000","last_became_active":"2026-02-13T02:41:50.607195+0000","last_became_peered":"2026-02-13T02:41:50.607195+0000","last_unstale":"2026-02-13T02:41:51.756712+0000","last_undegraded":"2026-02-13T02:41:51.756712+0000","last_fullsized":"2026-02-13T02:41:51.756712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:44.460181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.633992+0000","last_change":"2026-02-13T02:41:49.600637+0000","last_active":"2026-02-13T02:41:56.633992+0000","last_peered":"2026-02-13T02:41:56.633992+0000","last_clean":"2026-02-13T02:41:56.633992+0000","last_became_active":"2026-02-13T02:41:49.600502+0000","last_became_peered":"2026-02-13T02:41:49.600502+0000","last_unstale":"2026-02-13T02:41:56.633992+0000","last_undegraded":"2026-02-13T02:41:56.633992+0000","last_fullsized":"2026-02-13T02:41:56.633992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:42:59.607353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756802+0000","last_change":"2026-02-13T02:41:50.605595+0000","last_active":"2026-02-13T02:41:51.756802+0000","last_peered":"2026-02-13T02:41:51.756802+0000","last_clean":"2026-02-13T02:41:51.756802+0000","last_became_active":"2026-02-13T02:41:50.605404+0000","last_became_peered":"2026-02-13T02:41:50.605404+0000","last_unstale":"2026-02-13T02:41:51.756802+0000","last_undegraded":"2026-02-13T02:41:51.756802+0000","last_fullsized":"2026-02-13T02:41:51.756802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:15.374790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'28","reported_seq":67,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:06.652562+0000","last_change":"2026-02-13T02:41:49.600871+0000","last_active":"2026-02-13T02:42:06.652562+0000","last_peered":"2026-02-13T02:42:06.652562+0000","last_clean":"2026-02-13T02:42:06.652562+0000","last_became_active":"2026-02-13T02:41:49.600717+0000","last_became_peered":"2026-02-13T02:41:49.600717+0000","last_unstale":"2026-02-13T02:42:06.652562+0000","last_undegraded":"2026-02-13T02:42:06.652562+0000","last_fullsized":"2026-02-13T02:42:06.652562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:52:03.550683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62088,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":72,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638813+0000","last_change":"2026-02-13T02:41:50.601869+0000","last_active":"2026-02-13T02:41:51.638813+0000","last_peered":"2026-02-13T02:41:51.638813+0000","last_clean":"2026-02-13T02:41:51.638813+0000","last_became_active":"2026-02-13T02:41:50.601753+0000","last_became_peered":"2026-02-13T02:41:50.601753+0000","last_unstale":"2026-02-13T02:41:51.638813+0000","last_undegraded":"2026-02-13T02:41:51.638813+0000","last_fullsized":"2026-02-13T02:41:51.638813+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:24:53.246854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.640971+0000","last_change":"2026-02-13T02:41:49.605257+0000","last_active":"2026-02-13T02:41:58.640971+0000","last_peered":"2026-02-13T02:41:58.640971+0000","last_clean":"2026-02-13T02:41:58.640971+0000","last_became_active":"2026-02-13T02:41:49.605162+0000","last_became_peered":"2026-02-13T02:41:49.605162+0000","last_unstale":"2026-02-13T02:41:58.640971+0000","last_undegraded":"2026-02-13T02:41:58.640971+0000","last_fullsized":"2026-02-13T02:41:58.640971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:48:46.547144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756594+0000","last_change":"2026-02-13T02:41:50.608778+0000","last_active":"2026-02-13T02:41:51.756594+0000","last_peered":"2026-02-13T02:41:51.756594+0000","last_clean":"2026-02-13T02:41:51.756594+0000","last_became_active":"2026-02-13T02:41:50.608686+0000","last_became_peered":"2026-02-13T02:41:50.608686+0000","last_unstale":"2026-02-13T02:41:51.756594+0000","last_undegraded":"2026-02-13T02:41:51.756594+0000","last_fullsized":"2026-02-13T02:41:51.756594+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:01.765041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.640807+0000","last_change":"2026-02-13T02:41:49.603081+0000","last_active":"2026-02-13T02:41:57.640807+0000","last_peered":"2026-02-13T02:41:57.640807+0000","last_clean":"2026-02-13T02:41:57.640807+0000","last_became_active":"2026-02-13T02:41:49.602818+0000","last_became_peered":"2026-02-13T02:41:49.602818+0000","last_unstale":"2026-02-13T02:41:57.640807+0000","last_undegraded":"2026-02-13T02:41:57.640807+0000","last_fullsized":"2026-02-13T02:41:57.640807+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:55.523356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686167+0000","last_change":"2026-02-13T02:41:50.606663+0000","last_active":"2026-02-13T02:41:51.686167+0000","last_peered":"2026-02-13T02:41:51.686167+0000","last_clean":"2026-02-13T02:41:51.686167+0000","last_became_active":"2026-02-13T02:41:50.606460+0000","last_became_peered":"2026-02-13T02:41:50.606460+0000","last_unstale":"2026-02-13T02:41:51.686167+0000","last_undegraded":"2026-02-13T02:41:51.686167+0000","last_fullsized":"2026-02-13T02:41:51.686167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:23:24.744253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:07.659578+0000","last_change":"2026-02-13T02:41:49.597626+0000","last_active":"2026-02-13T02:42:07.659578+0000","last_peered":"2026-02-13T02:42:07.659578+0000","last_clean":"2026-02-13T02:42:07.659578+0000","last_became_active":"2026-02-13T02:41:49.597177+0000","last_became_peered":"2026-02-13T02:41:49.597177+0000","last_unstale":"2026-02-13T02:42:07.659578+0000","last_undegraded":"2026-02-13T02:42:07.659578+0000","last_fullsized":"2026-02-13T02:42:07.659578+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:43.194968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.685920+0000","last_change":"2026-02-13T02:41:50.605190+0000","last_active":"2026-02-13T02:41:51.685920+0000","last_peered":"2026-02-13T02:41:51.685920+0000","last_clean":"2026-02-13T02:41:51.685920+0000","last_became_active":"2026-02-13T02:41:50.604929+0000","last_became_peered":"2026-02-13T02:41:50.604929+0000","last_unstale":"2026-02-13T02:41:51.685920+0000","last_undegraded":"2026-02-13T02:41:51.685920+0000","last_fullsized":"2026-02-13T02:41:51.685920+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:41:19.216490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639971+0000","last_change":"2026-02-13T02:41:49.597710+0000","last_active":"2026-02-13T02:41:57.639971+0000","last_peered":"2026-02-13T02:41:57.639971+0000","last_clean":"2026-02-13T02:41:57.639971+0000","last_became_active":"2026-02-13T02:41:49.597545+0000","last_became_peered":"2026-02-13T02:41:49.597545+0000","last_unstale":"2026-02-13T02:41:57.639971+0000","last_undegraded":"2026-02-13T02:41:57.639971+0000","last_fullsized":"2026-02-13T02:41:57.639971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:40.978704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594383+0000","last_change":"2026-02-13T02:41:50.602185+0000","last_active":"2026-02-13T02:41:51.594383+0000","last_peered":"2026-02-13T02:41:51.594383+0000","last_clean":"2026-02-13T02:41:51.594383+0000","last_became_active":"2026-02-13T02:41:50.602029+0000","last_became_peered":"2026-02-13T02:41:50.602029+0000","last_unstale":"2026-02-13T02:41:51.594383+0000","last_undegraded":"2026-02-13T02:41:51.594383+0000","last_fullsized":"2026-02-13T02:41:51.594383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:44:46.598780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.624545+0000","last_change":"2026-02-13T02:41:49.596995+0000","last_active":"2026-02-13T02:41:57.624545+0000","last_peered":"2026-02-13T02:41:57.624545+0000","last_clean":"2026-02-13T02:41:57.624545+0000","last_became_active":"2026-02-13T02:41:49.596572+0000","last_became_peered":"2026-02-13T02:41:49.596572+0000","last_unstale":"2026-02-13T02:41:57.624545+0000","last_undegraded":"2026-02-13T02:41:57.624545+0000","last_fullsized":"2026-02-13T02:41:57.624545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:02.816921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753645+0000","last_change":"2026-02-13T02:41:50.600695+0000","last_active":"2026-02-13T02:41:51.753645+0000","last_peered":"2026-02-13T02:41:51.753645+0000","last_clean":"2026-02-13T02:41:51.753645+0000","last_became_active":"2026-02-13T02:41:50.600453+0000","last_became_peered":"2026-02-13T02:41:50.600453+0000","last_unstale":"2026-02-13T02:41:51.753645+0000","last_undegraded":"2026-02-13T02:41:51.753645+0000","last_fullsized":"2026-02-13T02:41:51.753645+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:50:55.092606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643996+0000","last_change":"2026-02-13T02:41:49.607644+0000","last_active":"2026-02-13T02:41:57.643996+0000","last_peered":"2026-02-13T02:41:57.643996+0000","last_clean":"2026-02-13T02:41:57.643996+0000","last_became_active":"2026-02-13T02:41:49.607523+0000","last_became_peered":"2026-02-13T02:41:49.607523+0000","last_unstale":"2026-02-13T02:41:57.643996+0000","last_undegraded":"2026-02-13T02:41:57.643996+0000","last_fullsized":"2026-02-13T02:41:57.643996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:33:38.869550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686358+0000","last_change":"2026-02-13T02:41:50.603530+0000","last_active":"2026-02-13T02:41:51.686358+0000","last_peered":"2026-02-13T02:41:51.686358+0000","last_clean":"2026-02-13T02:41:51.686358+0000","last_became_active":"2026-02-13T02:41:50.603312+0000","last_became_peered":"2026-02-13T02:41:50.603312+0000","last_unstale":"2026-02-13T02:41:51.686358+0000","last_undegraded":"2026-02-13T02:41:51.686358+0000","last_fullsized":"2026-02-13T02:41:51.686358+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:20.510472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.640687+0000","last_change":"2026-02-13T02:41:49.602974+0000","last_active":"2026-02-13T02:41:57.640687+0000","last_peered":"2026-02-13T02:41:57.640687+0000","last_clean":"2026-02-13T02:41:57.640687+0000","last_became_active":"2026-02-13T02:41:49.602734+0000","last_became_peered":"2026-02-13T02:41:49.602734+0000","last_unstale":"2026-02-13T02:41:57.640687+0000","last_undegraded":"2026-02-13T02:41:57.640687+0000","last_fullsized":"2026-02-13T02:41:57.640687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:55.811253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686213+0000","last_change":"2026-02-13T02:41:50.609569+0000","last_active":"2026-02-13T02:41:51.686213+0000","last_peered":"2026-02-13T02:41:51.686213+0000","last_clean":"2026-02-13T02:41:51.686213+0000","last_became_active":"2026-02-13T02:41:50.609385+0000","last_became_peered":"2026-02-13T02:41:50.609385+0000","last_unstale":"2026-02-13T02:41:51.686213+0000","last_undegraded":"2026-02-13T02:41:51.686213+0000","last_fullsized":"2026-02-13T02:41:51.686213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:01:38.361410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:05.647215+0000","last_change":"2026-02-13T02:41:49.597872+0000","last_active":"2026-02-13T02:42:05.647215+0000","last_peered":"2026-02-13T02:42:05.647215+0000","last_clean":"2026-02-13T02:42:05.647215+0000","last_became_active":"2026-02-13T02:41:49.597687+0000","last_became_peered":"2026-02-13T02:41:49.597687+0000","last_unstale":"2026-02-13T02:42:05.647215+0000","last_undegraded":"2026-02-13T02:42:05.647215+0000","last_fullsized":"2026-02-13T02:42:05.647215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:34:50.926874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686331+0000","last_change":"2026-02-13T02:41:50.603749+0000","last_active":"2026-02-13T02:41:51.686331+0000","last_peered":"2026-02-13T02:41:51.686331+0000","last_clean":"2026-02-13T02:41:51.686331+0000","last_became_active":"2026-02-13T02:41:50.603582+0000","last_became_peered":"2026-02-13T02:41:50.603582+0000","last_unstale":"2026-02-13T02:41:51.686331+0000","last_undegraded":"2026-02-13T02:41:51.686331+0000","last_fullsized":"2026-02-13T02:41:51.686331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:21:18.911738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686050+0000","last_change":"2026-02-13T02:41:25.005343+0000","last_active":"2026-02-13T02:41:51.686050+0000","last_peered":"2026-02-13T02:41:51.686050+0000","last_clean":"2026-02-13T02:41:51.686050+0000","last_became_active":"2026-02-13T02:41:25.005110+0000","last_became_peered":"2026-02-13T02:41:25.005110+0000","last_unstale":"2026-02-13T02:41:51.686050+0000","last_undegraded":"2026-02-13T02:41:51.686050+0000","last_fullsized":"2026-02-13T02:41:51.686050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:40:11.017896+0000","last_clean_scrub_stamp":"2026-02-13T02:40:11.017896+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:52:17.735016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.644630+0000","last_change":"2026-02-13T02:41:49.601087+0000","last_active":"2026-02-13T02:41:58.644630+0000","last_peered":"2026-02-13T02:41:58.644630+0000","last_clean":"2026-02-13T02:41:58.644630+0000","last_became_active":"2026-02-13T02:41:49.600937+0000","last_became_peered":"2026-02-13T02:41:49.600937+0000","last_unstale":"2026-02-13T02:41:58.644630+0000","last_undegraded":"2026-02-13T02:41:58.644630+0000","last_fullsized":"2026-02-13T02:41:58.644630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:00.587519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597194+0000","last_change":"2026-02-13T02:41:50.606319+0000","last_active":"2026-02-13T02:41:51.597194+0000","last_peered":"2026-02-13T02:41:51.597194+0000","last_clean":"2026-02-13T02:41:51.597194+0000","last_became_active":"2026-02-13T02:41:50.605323+0000","last_became_peered":"2026-02-13T02:41:50.605323+0000","last_unstale":"2026-02-13T02:41:51.597194+0000","last_undegraded":"2026-02-13T02:41:51.597194+0000","last_fullsized":"2026-02-13T02:41:51.597194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:30:37.743457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:55.629312+0000","last_change":"2026-02-13T02:41:49.599872+0000","last_active":"2026-02-13T02:41:55.629312+0000","last_peered":"2026-02-13T02:41:55.629312+0000","last_clean":"2026-02-13T02:41:55.629312+0000","last_became_active":"2026-02-13T02:41:49.599659+0000","last_became_peered":"2026-02-13T02:41:49.599659+0000","last_unstale":"2026-02-13T02:41:55.629312+0000","last_undegraded":"2026-02-13T02:41:55.629312+0000","last_fullsized":"2026-02-13T02:41:55.629312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:50:27.800392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.755902+0000","last_change":"2026-02-13T02:41:50.604627+0000","last_active":"2026-02-13T02:41:51.755902+0000","last_peered":"2026-02-13T02:41:51.755902+0000","last_clean":"2026-02-13T02:41:51.755902+0000","last_became_active":"2026-02-13T02:41:50.604541+0000","last_became_peered":"2026-02-13T02:41:50.604541+0000","last_unstale":"2026-02-13T02:41:51.755902+0000","last_undegraded":"2026-02-13T02:41:51.755902+0000","last_fullsized":"2026-02-13T02:41:51.755902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:43.968495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:06.657196+0000","last_change":"2026-02-13T02:41:49.608418+0000","last_active":"2026-02-13T02:42:06.657196+0000","last_peered":"2026-02-13T02:42:06.657196+0000","last_clean":"2026-02-13T02:42:06.657196+0000","last_became_active":"2026-02-13T02:41:49.608146+0000","last_became_peered":"2026-02-13T02:41:49.608146+0000","last_unstale":"2026-02-13T02:42:06.657196+0000","last_undegraded":"2026-02-13T02:42:06.657196+0000","last_fullsized":"2026-02-13T02:42:06.657196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:51.291825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594339+0000","last_change":"2026-02-13T02:41:50.601808+0000","last_active":"2026-02-13T02:41:51.594339+0000","last_peered":"2026-02-13T02:41:51.594339+0000","last_clean":"2026-02-13T02:41:51.594339+0000","last_became_active":"2026-02-13T02:41:50.601452+0000","last_became_peered":"2026-02-13T02:41:50.601452+0000","last_unstale":"2026-02-13T02:41:51.594339+0000","last_undegraded":"2026-02-13T02:41:51.594339+0000","last_fullsized":"2026-02-13T02:41:51.594339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:33.347585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:04.652056+0000","last_change":"2026-02-13T02:41:49.602005+0000","last_active":"2026-02-13T02:42:04.652056+0000","last_peered":"2026-02-13T02:42:04.652056+0000","last_clean":"2026-02-13T02:42:04.652056+0000","last_became_active":"2026-02-13T02:41:49.601849+0000","last_became_peered":"2026-02-13T02:41:49.601849+0000","last_unstale":"2026-02-13T02:42:04.652056+0000","last_undegraded":"2026-02-13T02:42:04.652056+0000","last_fullsized":"2026-02-13T02:42:04.652056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:41.055794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.598520+0000","last_change":"2026-02-13T02:41:50.605183+0000","last_active":"2026-02-13T02:41:51.598520+0000","last_peered":"2026-02-13T02:41:51.598520+0000","last_clean":"2026-02-13T02:41:51.598520+0000","last_became_active":"2026-02-13T02:41:50.604957+0000","last_became_peered":"2026-02-13T02:41:50.604957+0000","last_unstale":"2026-02-13T02:41:51.598520+0000","last_undegraded":"2026-02-13T02:41:51.598520+0000","last_fullsized":"2026-02-13T02:41:51.598520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:14:11.673149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756117+0000","last_change":"2026-02-13T02:41:49.600325+0000","last_active":"2026-02-13T02:41:51.756117+0000","last_peered":"2026-02-13T02:41:51.756117+0000","last_clean":"2026-02-13T02:41:51.756117+0000","last_became_active":"2026-02-13T02:41:49.600224+0000","last_became_peered":"2026-02-13T02:41:49.600224+0000","last_unstale":"2026-02-13T02:41:51.756117+0000","last_undegraded":"2026-02-13T02:41:51.756117+0000","last_fullsized":"2026-02-13T02:41:51.756117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:54.322610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.774595+0000","last_change":"2026-02-13T02:41:50.606498+0000","last_active":"2026-02-13T02:41:51.774595+0000","last_peered":"2026-02-13T02:41:51.774595+0000","last_clean":"2026-02-13T02:41:51.774595+0000","last_became_active":"2026-02-13T02:41:50.606363+0000","last_became_peered":"2026-02-13T02:41:50.606363+0000","last_unstale":"2026-02-13T02:41:51.774595+0000","last_undegraded":"2026-02-13T02:41:51.774595+0000","last_fullsized":"2026-02-13T02:41:51.774595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:01:26.416314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.642011+0000","last_change":"2026-02-13T02:41:49.598219+0000","last_active":"2026-02-13T02:41:57.642011+0000","last_peered":"2026-02-13T02:41:57.642011+0000","last_clean":"2026-02-13T02:41:57.642011+0000","last_became_active":"2026-02-13T02:41:49.598085+0000","last_became_peered":"2026-02-13T02:41:49.598085+0000","last_unstale":"2026-02-13T02:41:57.642011+0000","last_undegraded":"2026-02-13T02:41:57.642011+0000","last_fullsized":"2026-02-13T02:41:57.642011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:20:57.092957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756305+0000","last_change":"2026-02-13T02:41:50.608035+0000","last_active":"2026-02-13T02:41:51.756305+0000","last_peered":"2026-02-13T02:41:51.756305+0000","last_clean":"2026-02-13T02:41:51.756305+0000","last_became_active":"2026-02-13T02:41:50.607792+0000","last_became_peered":"2026-02-13T02:41:50.607792+0000","last_unstale":"2026-02-13T02:41:51.756305+0000","last_undegraded":"2026-02-13T02:41:51.756305+0000","last_fullsized":"2026-02-13T02:41:51.756305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:11:54.002715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'12","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:05.037710+0000","last_change":"2026-02-13T02:41:49.607784+0000","last_active":"2026-02-13T02:42:05.037710+0000","last_peered":"2026-02-13T02:42:05.037710+0000","last_clean":"2026-02-13T02:42:05.037710+0000","last_became_active":"2026-02-13T02:41:49.607602+0000","last_became_peered":"2026-02-13T02:41:49.607602+0000","last_unstale":"2026-02-13T02:42:05.037710+0000","last_undegraded":"2026-02-13T02:42:05.037710+0000","last_fullsized":"2026-02-13T02:42:05.037710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:36.215383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597453+0000","last_change":"2026-02-13T02:41:50.607352+0000","last_active":"2026-02-13T02:41:51.597453+0000","last_peered":"2026-02-13T02:41:51.597453+0000","last_clean":"2026-02-13T02:41:51.597453+0000","last_became_active":"2026-02-13T02:41:50.607212+0000","last_became_peered":"2026-02-13T02:41:50.607212+0000","last_unstale":"2026-02-13T02:41:51.597453+0000","last_undegraded":"2026-02-13T02:41:51.597453+0000","last_fullsized":"2026-02-13T02:41:51.597453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:22:52.063018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.643960+0000","last_change":"2026-02-13T02:41:49.600639+0000","last_active":"2026-02-13T02:41:57.643960+0000","last_peered":"2026-02-13T02:41:57.643960+0000","last_clean":"2026-02-13T02:41:57.643960+0000","last_became_active":"2026-02-13T02:41:49.600493+0000","last_became_peered":"2026-02-13T02:41:49.600493+0000","last_unstale":"2026-02-13T02:41:57.643960+0000","last_undegraded":"2026-02-13T02:41:57.643960+0000","last_fullsized":"2026-02-13T02:41:57.643960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:49:51.847533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756691+0000","last_change":"2026-02-13T02:41:50.608701+0000","last_active":"2026-02-13T02:41:51.756691+0000","last_peered":"2026-02-13T02:41:51.756691+0000","last_clean":"2026-02-13T02:41:51.756691+0000","last_became_active":"2026-02-13T02:41:50.608587+0000","last_became_peered":"2026-02-13T02:41:50.608587+0000","last_unstale":"2026-02-13T02:41:51.756691+0000","last_undegraded":"2026-02-13T02:41:51.756691+0000","last_fullsized":"2026-02-13T02:41:51.756691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:50:51.204751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.623861+0000","last_change":"2026-02-13T02:41:49.603944+0000","last_active":"2026-02-13T02:41:54.623861+0000","last_peered":"2026-02-13T02:41:54.623861+0000","last_clean":"2026-02-13T02:41:54.623861+0000","last_became_active":"2026-02-13T02:41:49.603771+0000","last_became_peered":"2026-02-13T02:41:49.603771+0000","last_unstale":"2026-02-13T02:41:54.623861+0000","last_undegraded":"2026-02-13T02:41:54.623861+0000","last_fullsized":"2026-02-13T02:41:54.623861+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:48:02.938077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.638571+0000","last_change":"2026-02-13T02:41:50.600369+0000","last_active":"2026-02-13T02:41:51.638571+0000","last_peered":"2026-02-13T02:41:51.638571+0000","last_clean":"2026-02-13T02:41:51.638571+0000","last_became_active":"2026-02-13T02:41:50.600236+0000","last_became_peered":"2026-02-13T02:41:50.600236+0000","last_unstale":"2026-02-13T02:41:51.638571+0000","last_undegraded":"2026-02-13T02:41:51.638571+0000","last_fullsized":"2026-02-13T02:41:51.638571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:33.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.644249+0000","last_change":"2026-02-13T02:41:49.606756+0000","last_active":"2026-02-13T02:41:57.644249+0000","last_peered":"2026-02-13T02:41:57.644249+0000","last_clean":"2026-02-13T02:41:57.644249+0000","last_became_active":"2026-02-13T02:41:49.606577+0000","last_became_peered":"2026-02-13T02:41:49.606577+0000","last_unstale":"2026-02-13T02:41:57.644249+0000","last_undegraded":"2026-02-13T02:41:57.644249+0000","last_fullsized":"2026-02-13T02:41:57.644249+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:22.336094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.753650+0000","last_change":"2026-02-13T02:41:50.596967+0000","last_active":"2026-02-13T02:41:51.753650+0000","last_peered":"2026-02-13T02:41:51.753650+0000","last_clean":"2026-02-13T02:41:51.753650+0000","last_became_active":"2026-02-13T02:41:50.596798+0000","last_became_peered":"2026-02-13T02:41:50.596798+0000","last_unstale":"2026-02-13T02:41:51.753650+0000","last_undegraded":"2026-02-13T02:41:51.753650+0000","last_fullsized":"2026-02-13T02:41:51.753650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:46.105964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:56.633081+0000","last_change":"2026-02-13T02:41:49.605314+0000","last_active":"2026-02-13T02:41:56.633081+0000","last_peered":"2026-02-13T02:41:56.633081+0000","last_clean":"2026-02-13T02:41:56.633081+0000","last_became_active":"2026-02-13T02:41:49.605183+0000","last_became_peered":"2026-02-13T02:41:49.605183+0000","last_unstale":"2026-02-13T02:41:56.633081+0000","last_undegraded":"2026-02-13T02:41:56.633081+0000","last_fullsized":"2026-02-13T02:41:56.633081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:58:55.197111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597243+0000","last_change":"2026-02-13T02:41:50.605693+0000","last_active":"2026-02-13T02:41:51.597243+0000","last_peered":"2026-02-13T02:41:51.597243+0000","last_clean":"2026-02-13T02:41:51.597243+0000","last_became_active":"2026-02-13T02:41:50.605095+0000","last_became_peered":"2026-02-13T02:41:50.605095+0000","last_unstale":"2026-02-13T02:41:51.597243+0000","last_undegraded":"2026-02-13T02:41:51.597243+0000","last_fullsized":"2026-02-13T02:41:51.597243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:03:20.729194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:54.620279+0000","last_change":"2026-02-13T02:41:49.597243+0000","last_active":"2026-02-13T02:41:54.620279+0000","last_peered":"2026-02-13T02:41:54.620279+0000","last_clean":"2026-02-13T02:41:54.620279+0000","last_became_active":"2026-02-13T02:41:49.596866+0000","last_became_peered":"2026-02-13T02:41:49.596866+0000","last_unstale":"2026-02-13T02:41:54.620279+0000","last_undegraded":"2026-02-13T02:41:54.620279+0000","last_fullsized":"2026-02-13T02:41:54.620279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:29:38.001131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.686068+0000","last_change":"2026-02-13T02:41:50.606794+0000","last_active":"2026-02-13T02:41:51.686068+0000","last_peered":"2026-02-13T02:41:51.686068+0000","last_clean":"2026-02-13T02:41:51.686068+0000","last_became_active":"2026-02-13T02:41:50.606595+0000","last_became_peered":"2026-02-13T02:41:50.606595+0000","last_unstale":"2026-02-13T02:41:51.686068+0000","last_undegraded":"2026-02-13T02:41:51.686068+0000","last_fullsized":"2026-02-13T02:41:51.686068+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:24.706074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.594579+0000","last_change":"2026-02-13T02:41:50.602019+0000","last_active":"2026-02-13T02:41:51.594579+0000","last_peered":"2026-02-13T02:41:51.594579+0000","last_clean":"2026-02-13T02:41:51.594579+0000","last_became_active":"2026-02-13T02:41:50.601731+0000","last_became_peered":"2026-02-13T02:41:50.601731+0000","last_unstale":"2026-02-13T02:41:51.594579+0000","last_undegraded":"2026-02-13T02:41:51.594579+0000","last_fullsized":"2026-02-13T02:41:51.594579+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:19.211804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:57.639877+0000","last_change":"2026-02-13T02:41:49.596759+0000","last_active":"2026-02-13T02:41:57.639877+0000","last_peered":"2026-02-13T02:41:57.639877+0000","last_clean":"2026-02-13T02:41:57.639877+0000","last_became_active":"2026-02-13T02:41:49.596314+0000","last_became_peered":"2026-02-13T02:41:49.596314+0000","last_unstale":"2026-02-13T02:41:57.639877+0000","last_undegraded":"2026-02-13T02:41:57.639877+0000","last_fullsized":"2026-02-13T02:41:57.639877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:20:20.626173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756768+0000","last_change":"2026-02-13T02:41:50.605832+0000","last_active":"2026-02-13T02:41:51.756768+0000","last_peered":"2026-02-13T02:41:51.756768+0000","last_clean":"2026-02-13T02:41:51.756768+0000","last_became_active":"2026-02-13T02:41:50.605574+0000","last_became_peered":"2026-02-13T02:41:50.605574+0000","last_unstale":"2026-02-13T02:41:51.756768+0000","last_undegraded":"2026-02-13T02:41:51.756768+0000","last_fullsized":"2026-02-13T02:41:51.756768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:33:32.847010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:58.638633+0000","last_change":"2026-02-13T02:41:49.596987+0000","last_active":"2026-02-13T02:41:58.638633+0000","last_peered":"2026-02-13T02:41:58.638633+0000","last_clean":"2026-02-13T02:41:58.638633+0000","last_became_active":"2026-02-13T02:41:49.596599+0000","last_became_peered":"2026-02-13T02:41:49.596599+0000","last_unstale":"2026-02-13T02:41:58.638633+0000","last_undegraded":"2026-02-13T02:41:58.638633+0000","last_fullsized":"2026-02-13T02:41:58.638633+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:30.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.756702+0000","last_change":"2026-02-13T02:41:50.610429+0000","last_active":"2026-02-13T02:41:51.756702+0000","last_peered":"2026-02-13T02:41:51.756702+0000","last_clean":"2026-02-13T02:41:51.756702+0000","last_became_active":"2026-02-13T02:41:50.610239+0000","last_became_peered":"2026-02-13T02:41:50.610239+0000","last_unstale":"2026-02-13T02:41:51.756702+0000","last_undegraded":"2026-02-13T02:41:51.756702+0000","last_fullsized":"2026-02-13T02:41:51.756702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:02:40.272140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:52.062405+0000","last_change":"2026-02-13T02:41:49.606193+0000","last_active":"2026-02-13T02:41:52.062405+0000","last_peered":"2026-02-13T02:41:52.062405+0000","last_clean":"2026-02-13T02:41:52.062405+0000","last_became_active":"2026-02-13T02:41:49.606085+0000","last_became_peered":"2026-02-13T02:41:49.606085+0000","last_unstale":"2026-02-13T02:41:52.062405+0000","last_undegraded":"2026-02-13T02:41:52.062405+0000","last_fullsized":"2026-02-13T02:41:52.062405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:49:14.551780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:41:51.597364+0000","last_change":"2026-02-13T02:41:50.608679+0000","last_active":"2026-02-13T02:41:51.597364+0000","last_peered":"2026-02-13T02:41:51.597364+0000","last_clean":"2026-02-13T02:41:51.597364+0000","last_became_active":"2026-02-13T02:41:50.607474+0000","last_became_peered":"2026-02-13T02:41:50.607474+0000","last_unstale":"2026-02-13T02:41:51.597364+0000","last_undegraded":"2026-02-13T02:41:51.597364+0000","last_fullsized":"2026-02-13T02:41:51.597364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:49.590728+0000","last_clean_scrub_stamp":"2026-02-13T02:41:49.590728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:49:25.463410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T02:42:07.652885+0000","last_change":"2026-02-13T02:41:49.599289+0000","last_active":"2026-02-13T02:42:07.652885+0000","last_peered":"2026-02-13T02:42:07.652885+0000","last_clean":"2026-02-13T02:42:07.652885+0000","last_became_active":"2026-02-13T02:41:49.598567+0000","last_became_peered":"2026-02-13T02:41:49.598567+0000","last_unstale":"2026-02-13T02:42:07.652885+0000","last_undegraded":"2026-02-13T02:42:07.652885+0000","last_fullsized":"2026-02-13T02:42:07.652885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:41:48.583119+0000","last_clean_scrub_stamp":"2026-02-13T02:41:48.583119+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:23.527572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69850,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":129,"num_read_kb":141,"num_write":236,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":302672,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":264489,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710730,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":399099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939659,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27924,"kb_used_data":960,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975276,"statfs":{"total":751619276800,"available":751590682624,"internally_reserved":0,"allocated":983040,"data_stored":1052216,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33581,"internal_metadata":27557075},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103182,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":398619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33874,"internal_metadata":27556782},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332112,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":399019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34076,"internal_metadata":27556580},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561040,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27844,"kb_used_data":880,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975356,"statfs":{"total":751619276800,"available":751590764544,"internally_reserved":0,"allocated":901120,"data_stored":991966,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":34554,"internal_metadata":27556102},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":398314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34870,"internal_metadata":27555786},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920788,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27856,"kb_used_data":892,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975344,"statfs":{"total":751619276800,"available":751590752256,"internally_reserved":0,"allocated":913408,"data_stored":991256,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33490,"internal_metadata":27557166},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051606,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27780,"kb_used_data":816,"kb_used_omap":42,"kb_used_meta":26901,"kb_avail":733975420,"statfs":{"total":751619276800,"available":751590830080,"internally_reserved":0,"allocated":835584,"data_stored":398585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43851,"internal_metadata":27546805},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280536,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":398139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47978,"internal_metadata":27542678},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27860,"kb_used_data":896,"kb_used_omap":58,"kb_used_meta":26885,"kb_avail":733975340,"statfs":{"total":751619276800,"available":751590748160,"internally_reserved":0,"allocated":917504,"data_stored":462377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60241,"internal_metadata":27530415},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27840,"kb_used_data":876,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975360,"statfs":{"total":751619276800,"available":751590768640,"internally_reserved":0,"allocated":897024,"data_stored":461359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45723,"internal_metadata":27544933},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":400107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50354,"internal_metadata":27540302},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36612,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11364,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2724,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58647,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46386,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26177,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9904,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11905,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32965,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32379,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32275,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":64256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31982,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5964,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:42:10.777 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T02:42:10.778 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T02:42:10.778 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T02:42:10.778 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:10.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:10 trial091 ceph-mon[27614]: pgmap v187: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 22 op/s 2026-02-13T02:42:10.961 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:10.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:10 trial078 ceph-mon[22944]: pgmap v187: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 22 op/s 2026-02-13T02:42:11.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:10 trial154 ceph-mon[27921]: pgmap v187: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 22 op/s 2026-02-13T02:42:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2244423329 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 msgr2=0x7f9dac17e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2244423329 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 0x7f9dac17e380 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=8508105171188121215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9da000aa40 tx=0x7f9da002fdf0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2244423329 shutdown_connections 2026-02-13T02:42:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2244423329 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 0x7f9dac17e380 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=8508105171188121215 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2244423329 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dac114300 0x7f9dac114730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2244423329 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac117340 0x7f9dac113dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2244423329 >> 10.20.193.78:0/2244423329 conn(0x7f9dac05b290 msgr2=0x7f9dac05b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:11.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2244423329 shutdown_connections 2026-02-13T02:42:11.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2244423329 wait complete. 2026-02-13T02:42:11.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.147+0000 7f9db11e76c0 1 Processor -- start 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db11e76c0 1 -- start start 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db11e76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac114300 0x7f9dac0fd130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db11e76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dac117340 0x7f9dac0fd670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db11e76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 0x7f9dac102a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db11e76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac103080 con 0x7f9dac114300 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db11e76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1031f0 con 0x7f9dac15dfa0 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db11e76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1033b0 con 0x7f9dac117340 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac114300 0x7f9dac0fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac114300 0x7f9dac0fd130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34356/0 (socket says 10.20.193.78:34356) 2026-02-13T02:42:11.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 -- 10.20.193.78:0/2924565240 learned_addr learned my addr 10.20.193.78:0/2924565240 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dab7fe6c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dac117340 0x7f9dac0fd670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9db09e66c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 0x7f9dac102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 -- 10.20.193.78:0/2924565240 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dac117340 msgr2=0x7f9dac0fd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dac117340 0x7f9dac0fd670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 -- 10.20.193.78:0/2924565240 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 msgr2=0x7f9dac102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 0x7f9dac102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 -- 10.20.193.78:0/2924565240 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da000a660 con 0x7f9dac114300 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.148+0000 7f9dabfff6c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac114300 0x7f9dac0fd130 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d98009490 tx=0x7f9d9800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.149+0000 7f9da97fa6c0 1 -- 10.20.193.78:0/2924565240 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d98004a80 con 0x7f9dac114300 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.149+0000 7f9da97fa6c0 1 -- 10.20.193.78:0/2924565240 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9d98009030 con 0x7f9dac114300 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.149+0000 7f9da97fa6c0 1 -- 10.20.193.78:0/2924565240 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d980071c0 con 0x7f9dac114300 2026-02-13T02:42:11.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.149+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dac103690 con 0x7f9dac114300 2026-02-13T02:42:11.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.149+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dac15c130 con 0x7f9dac114300 2026-02-13T02:42:11.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.149+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dac05e670 con 0x7f9dac114300 2026-02-13T02:42:11.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.151+0000 7f9da97fa6c0 1 -- 10.20.193.78:0/2924565240 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9d98004d00 con 0x7f9dac114300 2026-02-13T02:42:11.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.153+0000 7f9da97fa6c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d800b56e0 0x7f9d800d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:11.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.153+0000 7f9da97fa6c0 1 -- 10.20.193.78:0/2924565240 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9d980e3cc0 con 0x7f9dac114300 2026-02-13T02:42:11.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.153+0000 7f9da97fa6c0 1 -- 10.20.193.78:0/2924565240 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9d980e4140 con 0x7f9dac114300 2026-02-13T02:42:11.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.153+0000 7f9dab7fe6c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d800b56e0 0x7f9d800d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:11.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.153+0000 7f9dab7fe6c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d800b56e0 0x7f9d800d5b90 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dac103ac0 tx=0x7f9d9c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:11.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.276+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9dac114730 con 0x7f9dac114300 2026-02-13T02:42:11.278 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.276+0000 7f9da97fa6c0 1 -- 10.20.193.78:0/2924565240 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9d980a6740 con 0x7f9dac114300 2026-02-13T02:42:11.278 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:11.278 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:11.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d800b56e0 msgr2=0x7f9d800d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:11.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d800b56e0 0x7f9d800d5b90 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dac103ac0 tx=0x7f9d9c009260 comp rx=0 tx=0).stop 2026-02-13T02:42:11.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac114300 msgr2=0x7f9dac0fd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:11.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac114300 0x7f9dac0fd130 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d98009490 tx=0x7f9d9800bca0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.279 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 shutdown_connections 2026-02-13T02:42:11.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9d800b56e0 0x7f9d800d5b90 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9dac15dfa0 0x7f9dac102a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9dac117340 0x7f9dac0fd670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 --2- 10.20.193.78:0/2924565240 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9dac114300 0x7f9dac0fd130 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:11.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 >> 10.20.193.78:0/2924565240 conn(0x7f9dac05b290 msgr2=0x7f9dac0f7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:11.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 shutdown_connections 2026-02-13T02:42:11.280 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:11.277+0000 7f9db11e76c0 1 -- 10.20.193.78:0/2924565240 wait complete. 2026-02-13T02:42:11.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:11 trial091 ceph-mon[27614]: from='client.24949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:11.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:11 trial091 ceph-mon[27614]: from='client.24983 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:11.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:11 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2924565240' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:11.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:11 trial078 ceph-mon[22944]: from='client.24949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:11.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:11 trial078 ceph-mon[22944]: from='client.24983 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:11.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:11 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2924565240' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:12.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:11 trial154 ceph-mon[27921]: from='client.24949 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:12.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:11 trial154 ceph-mon[27921]: from='client.24983 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:42:12.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:11 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2924565240' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:12.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:12 trial091 ceph-mon[27614]: pgmap v188: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2026-02-13T02:42:12.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:12 trial078 ceph-mon[22944]: pgmap v188: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2026-02-13T02:42:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:12 trial154 ceph-mon[27921]: pgmap v188: 97 pgs: 97 active+clean; 645 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2026-02-13T02:42:14.382 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:14.565 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:14.697 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:14 trial078 ceph-mon[22944]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/2496710233 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810fbf0 msgr2=0x7fd0e8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/2496710233 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810fbf0 0x7fd0e8114c30 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=17098854852894574780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0d0009970 tx=0x7fd0d002ed10 comp rx=0 tx=0).stop 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/2496710233 shutdown_connections 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/2496710233 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 0x7fd0e8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/2496710233 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810fbf0 0x7fd0e8114c30 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=17098854852894574780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/2496710233 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd0e810f200 0x7fd0e810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/2496710233 >> 10.20.193.78:0/2496710233 conn(0x7fd0e80ecb00 msgr2=0x7fd0e810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/2496710233 shutdown_connections 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.764+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/2496710233 wait complete. 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 Processor -- start 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 -- start start 2026-02-13T02:42:14.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810f200 0x7fd0e80f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 0x7fd0e8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd0e80f5140 0x7fd0e80fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80f5830 con 0x7fd0e8115410 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80fa950 con 0x7fd0e810f200 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0ed2cc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e80fab10 con 0x7fd0e80f5140 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0e67fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 0x7fd0e8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.765+0000 7fd0e6ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810f200 0x7fd0e80f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e67fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 0x7fd0e8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34382/0 (socket says 10.20.193.78:34382) 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e67fc6c0 1 -- 10.20.193.78:0/977377738 learned_addr learned my addr 10.20.193.78:0/977377738 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e6ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810f200 0x7fd0e80f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:60660/0 (socket says 10.20.193.78:60660) 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e77fe6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd0e80f5140 0x7fd0e80fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e6ffd6c0 1 -- 10.20.193.78:0/977377738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd0e80f5140 msgr2=0x7fd0e80fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e6ffd6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd0e80f5140 0x7fd0e80fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e6ffd6c0 1 -- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 msgr2=0x7fd0e8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e6ffd6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 0x7fd0e8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e6ffd6c0 1 -- 10.20.193.78:0/977377738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d0009590 con 0x7fd0e810f200 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e67fc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 0x7fd0e8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:14.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0e6ffd6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810f200 0x7fd0e80f4b10 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0dc00b670 tx=0x7fd0dc00bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:14.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0bffff6c0 1 -- 10.20.193.78:0/977377738 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0dc0044a0 con 0x7fd0e810f200 2026-02-13T02:42:14.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0bffff6c0 1 -- 10.20.193.78:0/977377738 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd0dc009030 con 0x7fd0e810f200 2026-02-13T02:42:14.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0bffff6c0 1 -- 10.20.193.78:0/977377738 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0dc00cc10 con 0x7fd0e810f200 2026-02-13T02:42:14.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e80fadf0 con 0x7fd0e810f200 2026-02-13T02:42:14.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.766+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e80fb280 con 0x7fd0e810f200 2026-02-13T02:42:14.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.767+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e81104d0 con 0x7fd0e810f200 2026-02-13T02:42:14.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.769+0000 7fd0bffff6c0 1 -- 10.20.193.78:0/977377738 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fd0dc0026b0 con 0x7fd0e810f200 2026-02-13T02:42:14.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.770+0000 7fd0bffff6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd0b80b5760 0x7fd0b80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:14.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.770+0000 7fd0bffff6c0 1 -- 10.20.193.78:0/977377738 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd0dc0e38a0 con 0x7fd0e810f200 2026-02-13T02:42:14.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.771+0000 7fd0e67fc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd0b80b5760 0x7fd0b80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:14.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.771+0000 7fd0bffff6c0 1 -- 10.20.193.78:0/977377738 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd0dc0e3d20 con 0x7fd0e810f200 2026-02-13T02:42:14.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.771+0000 7fd0e67fc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd0b80b5760 0x7fd0b80d5c10 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0e80fb4a0 tx=0x7fd0d0005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:14.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.893+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd0e810f5d0 con 0x7fd0e810f200 2026-02-13T02:42:14.895 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.894+0000 7fd0bffff6c0 1 -- 10.20.193.78:0/977377738 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd0dc0a61f0 con 0x7fd0e810f200 2026-02-13T02:42:14.895 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:14.895 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd0b80b5760 msgr2=0x7fd0b80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd0b80b5760 0x7fd0b80d5c10 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0e80fb4a0 tx=0x7fd0d0005ae0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810f200 msgr2=0x7fd0e80f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810f200 0x7fd0e80f4b10 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0dc00b670 tx=0x7fd0dc00bb40 comp rx=0 tx=0).stop 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 shutdown_connections 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd0b80b5760 0x7fd0b80d5c10 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd0e80f5140 0x7fd0e80fa410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd0e8115410 0x7fd0e8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.896 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 --2- 10.20.193.78:0/977377738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd0e810f200 0x7fd0e80f4b10 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:14.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 >> 10.20.193.78:0/977377738 conn(0x7fd0e80ecb00 msgr2=0x7fd0e8113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:14.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 shutdown_connections 2026-02-13T02:42:14.897 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:14.895+0000 7fd0ed2cc6c0 1 -- 10.20.193.78:0/977377738 wait complete. 2026-02-13T02:42:14.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:14 trial091 ceph-mon[27614]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2026-02-13T02:42:15.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:14 trial154 ceph-mon[27921]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 6.9 KiB/s wr, 15 op/s 2026-02-13T02:42:15.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:15 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/977377738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:15.976 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:15 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/977377738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:16.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:15 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/977377738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:16.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:16 trial091 ceph-mon[27614]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-13T02:42:16.976 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:16 trial078 ceph-mon[22944]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-13T02:42:17.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:16 trial154 ceph-mon[27921]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2026-02-13T02:42:18.000 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:18.184 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.367+0000 7f28096b26c0 1 -- 10.20.193.78:0/254731121 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410fa50 msgr2=0x7f2804114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.367+0000 7f28096b26c0 1 --2- 10.20.193.78:0/254731121 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410fa50 0x7f2804114a90 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=539144991196838449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27f40099a0 tx=0x7f27f402ed00 comp rx=0 tx=0).stop 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.367+0000 7f28096b26c0 1 -- 10.20.193.78:0/254731121 shutdown_connections 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.367+0000 7f28096b26c0 1 --2- 10.20.193.78:0/254731121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 0x7f2804175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.367+0000 7f28096b26c0 1 --2- 10.20.193.78:0/254731121 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410fa50 0x7f2804114a90 unknown :-1 s=CLOSED pgs=202 gs=2 cs=0 l=1 c_cookie=539144991196838449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.367+0000 7f28096b26c0 1 --2- 10.20.193.78:0/254731121 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f280410f060 0x7f280410f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.367+0000 7f28096b26c0 1 -- 10.20.193.78:0/254731121 >> 10.20.193.78:0/254731121 conn(0x7f28040ec980 msgr2=0x7f280410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.368+0000 7f28096b26c0 1 -- 10.20.193.78:0/254731121 shutdown_connections 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.368+0000 7f28096b26c0 1 -- 10.20.193.78:0/254731121 wait complete. 2026-02-13T02:42:18.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.368+0000 7f28096b26c0 1 Processor -- start 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.368+0000 7f28096b26c0 1 -- start start 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28096b26c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410f060 0x7f28040f4a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28096b26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 0x7f2804175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28096b26c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f28040f50a0 0x7f28040fa370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28096b26c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28040f5790 con 0x7f280410f060 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28096b26c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f28040fa8b0 con 0x7f2804115270 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28096b26c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28040faa70 con 0x7f28040f50a0 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 0x7f2804175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 0x7f2804175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:47194/0 (socket says 10.20.193.78:47194) 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 -- 10.20.193.78:0/430041712 learned_addr learned my addr 10.20.193.78:0/430041712 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f2803fff6c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410f060 0x7f28040f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 -- 10.20.193.78:0/430041712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f28040f50a0 msgr2=0x7f28040fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f28040f50a0 0x7f28040fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 -- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410f060 msgr2=0x7f28040f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410f060 0x7f28040f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 -- 10.20.193.78:0/430041712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f4009590 con 0x7f2804115270 2026-02-13T02:42:18.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28037fe6c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 0x7f2804175b10 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27f4009290 tx=0x7f27f402fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:18.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28017fa6c0 1 -- 10.20.193.78:0/430041712 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27f4002ae0 con 0x7f2804115270 2026-02-13T02:42:18.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28017fa6c0 1 -- 10.20.193.78:0/430041712 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f27f40046b0 con 0x7f2804115270 2026-02-13T02:42:18.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28017fa6c0 1 -- 10.20.193.78:0/430041712 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27f40312b0 con 0x7f2804115270 2026-02-13T02:42:18.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.369+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28040facf0 con 0x7f2804115270 2026-02-13T02:42:18.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.370+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28040fb120 con 0x7f2804115270 2026-02-13T02:42:18.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.370+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2804110330 con 0x7f2804115270 2026-02-13T02:42:18.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.372+0000 7f28017fa6c0 1 -- 10.20.193.78:0/430041712 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f27f4002c40 con 0x7f2804115270 2026-02-13T02:42:18.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.374+0000 7f28017fa6c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27d80b56e0 0x7f27d80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:18.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.374+0000 7f28017fa6c0 1 -- 10.20.193.78:0/430041712 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f27f4107d30 con 0x7f2804115270 2026-02-13T02:42:18.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.374+0000 7f28017fa6c0 1 -- 10.20.193.78:0/430041712 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f27f41081b0 con 0x7f2804115270 2026-02-13T02:42:18.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.374+0000 7f2803fff6c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27d80b56e0 0x7f27d80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:18.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.375+0000 7f2803fff6c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27d80b56e0 0x7f27d80d5b90 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27f0004750 tx=0x7f27f0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:18.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.498+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f280410fa50 con 0x7f2804115270 2026-02-13T02:42:18.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.498+0000 7f28017fa6c0 1 -- 10.20.193.78:0/430041712 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f27f40ca680 con 0x7f2804115270 2026-02-13T02:42:18.499 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:18.500 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:18.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27d80b56e0 msgr2=0x7f27d80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:18.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27d80b56e0 0x7f27d80d5b90 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27f0004750 tx=0x7f27f0009260 comp rx=0 tx=0).stop 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 msgr2=0x7f2804175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 0x7f2804175b10 secure :-1 s=READY pgs=129 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27f4009290 tx=0x7f27f402fc60 comp rx=0 tx=0).stop 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 shutdown_connections 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f27d80b56e0 0x7f27d80d5b90 unknown :-1 s=CLOSED pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f28040f50a0 0x7f28040fa370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2804115270 0x7f2804175b10 unknown :-1 s=CLOSED pgs=129 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 --2- 10.20.193.78:0/430041712 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f280410f060 0x7f28040f4a70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 >> 10.20.193.78:0/430041712 conn(0x7f28040ec980 msgr2=0x7f2804113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 shutdown_connections 2026-02-13T02:42:18.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:18.499+0000 7f28096b26c0 1 -- 10.20.193.78:0/430041712 wait complete. 2026-02-13T02:42:18.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:18 trial091 ceph-mon[27614]: pgmap v191: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-13T02:42:18.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:18 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/430041712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:18.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:18 trial078 ceph-mon[22944]: pgmap v191: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-13T02:42:18.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:18 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/430041712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:19.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:18 trial154 ceph-mon[27921]: pgmap v191: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.8 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2026-02-13T02:42:19.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:18 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/430041712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:20.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:20 trial091 ceph-mon[27614]: pgmap v192: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-13T02:42:20.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:20 trial078 ceph-mon[22944]: pgmap v192: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-13T02:42:21.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:20 trial154 ceph-mon[27921]: pgmap v192: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-13T02:42:21.604 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:21.788 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:21.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 -- 10.20.193.78:0/2028486245 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb24810fa50 msgr2=0x7fb248114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:21.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 --2- 10.20.193.78:0/2028486245 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb24810fa50 0x7fb248114a90 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=10265321237038038322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb230009970 tx=0x7fb23002ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:21.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 -- 10.20.193.78:0/2028486245 shutdown_connections 2026-02-13T02:42:21.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 --2- 10.20.193.78:0/2028486245 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb248115270 0x7fb248175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:21.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 --2- 10.20.193.78:0/2028486245 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb24810fa50 0x7fb248114a90 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=10265321237038038322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:21.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 --2- 10.20.193.78:0/2028486245 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb24810f060 0x7fb24810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:21.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 -- 10.20.193.78:0/2028486245 >> 10.20.193.78:0/2028486245 conn(0x7fb2480ec980 msgr2=0x7fb24810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:21.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 -- 10.20.193.78:0/2028486245 shutdown_connections 2026-02-13T02:42:21.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 -- 10.20.193.78:0/2028486245 wait complete. 2026-02-13T02:42:21.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.983+0000 7fb2475776c0 1 Processor -- start 2026-02-13T02:42:21.987 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2475776c0 1 -- start start 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2475776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb24810f060 0x7fb2480f4970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2475776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb248115270 0x7fb248175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2475776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2480f4fa0 0x7fb2480fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2475776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480f5690 con 0x7fb24810f060 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2475776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480fa7b0 con 0x7fb2480f4fa0 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2475776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480fa970 con 0x7fb248115270 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb24810f060 0x7fb2480f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb24810f060 0x7fb2480f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:54288/0 (socket says 10.20.193.78:54288) 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 -- 10.20.193.78:0/317535522 learned_addr learned my addr 10.20.193.78:0/317535522 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:21.988 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb245d746c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb248115270 0x7fb248175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb246d766c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2480f4fa0 0x7fb2480fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 -- 10.20.193.78:0/317535522 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb248115270 msgr2=0x7fb248175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb248115270 0x7fb248175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 -- 10.20.193.78:0/317535522 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2480f4fa0 msgr2=0x7fb2480fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2480f4fa0 0x7fb2480fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.984+0000 7fb2465756c0 1 -- 10.20.193.78:0/317535522 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb230009590 con 0x7fb24810f060 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.985+0000 7fb2465756c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb24810f060 0x7fb2480f4970 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb23c009490 tx=0x7fb23c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.985+0000 7fb22f7fe6c0 1 -- 10.20.193.78:0/317535522 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb23c004a80 con 0x7fb24810f060 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.985+0000 7fb22f7fe6c0 1 -- 10.20.193.78:0/317535522 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb23c009030 con 0x7fb24810f060 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.985+0000 7fb22f7fe6c0 1 -- 10.20.193.78:0/317535522 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb23c0071c0 con 0x7fb24810f060 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.985+0000 7fb2475776c0 1 -- 10.20.193.78:0/317535522 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2480fac50 con 0x7fb24810f060 2026-02-13T02:42:21.989 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.985+0000 7fb2475776c0 1 -- 10.20.193.78:0/317535522 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2480fb0e0 con 0x7fb24810f060 2026-02-13T02:42:21.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.986+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb248110330 con 0x7fb24810f060 2026-02-13T02:42:21.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.988+0000 7fb22f7fe6c0 1 -- 10.20.193.78:0/317535522 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fb23c005000 con 0x7fb24810f060 2026-02-13T02:42:21.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.990+0000 7fb22f7fe6c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb2200b56e0 0x7fb2200d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:21.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.990+0000 7fb22f7fe6c0 1 -- 10.20.193.78:0/317535522 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fb23c0e3af0 con 0x7fb24810f060 2026-02-13T02:42:21.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.990+0000 7fb22f7fe6c0 1 -- 10.20.193.78:0/317535522 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb23c11c5e0 con 0x7fb24810f060 2026-02-13T02:42:21.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.990+0000 7fb245d746c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb2200b56e0 0x7fb2200d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:21.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:21.990+0000 7fb245d746c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb2200b56e0 0x7fb2200d5b90 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2300023e0 tx=0x7fb230005c60 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:22.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.114+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb2480f5ac0 con 0x7fb24810f060 2026-02-13T02:42:22.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.115+0000 7fb22f7fe6c0 1 -- 10.20.193.78:0/317535522 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb23c0a6440 con 0x7fb24810f060 2026-02-13T02:42:22.117 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:22.117 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb2200b56e0 msgr2=0x7fb2200d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb2200b56e0 0x7fb2200d5b90 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2300023e0 tx=0x7fb230005c60 comp rx=0 tx=0).stop 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb24810f060 msgr2=0x7fb2480f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb24810f060 0x7fb2480f4970 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb23c009490 tx=0x7fb23c00bc50 comp rx=0 tx=0).stop 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 shutdown_connections 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb2200b56e0 0x7fb2200d5b90 unknown :-1 s=CLOSED pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2480f4fa0 0x7fb2480fa270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:22.118 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb248115270 0x7fb248175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:22.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 --2- 10.20.193.78:0/317535522 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb24810f060 0x7fb2480f4970 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:22.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 >> 10.20.193.78:0/317535522 conn(0x7fb2480ec980 msgr2=0x7fb24810d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:22.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 shutdown_connections 2026-02-13T02:42:22.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:22.116+0000 7fb22d7fa6c0 1 -- 10.20.193.78:0/317535522 wait complete. 2026-02-13T02:42:22.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:22 trial091 ceph-mon[27614]: pgmap v193: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-13T02:42:22.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:22 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/317535522' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:22.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:22 trial078 ceph-mon[22944]: pgmap v193: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-13T02:42:22.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:22 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/317535522' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:23.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:22 trial154 ceph-mon[27921]: pgmap v193: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2026-02-13T02:42:23.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:22 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/317535522' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:24.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:24 trial091 ceph-mon[27614]: pgmap v194: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-13T02:42:24.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:24 trial078 ceph-mon[22944]: pgmap v194: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-13T02:42:25.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:24 trial154 ceph-mon[27921]: pgmap v194: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 853 B/s wr, 11 op/s 2026-02-13T02:42:25.221 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:25.408 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:25.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 -- 10.20.193.78:0/3493378117 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 msgr2=0x7f005010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:25.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/3493378117 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 0x7f005010f430 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=13172908861698616351 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0044009970 tx=0x7f004402ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:25.597 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 -- 10.20.193.78:0/3493378117 shutdown_connections 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/3493378117 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0050115270 0x7f0050175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/3493378117 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f005010fa50 0x7f0050114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/3493378117 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 0x7f005010f430 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=13172908861698616351 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 -- 10.20.193.78:0/3493378117 >> 10.20.193.78:0/3493378117 conn(0x7f00500ec980 msgr2=0x7f005010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 -- 10.20.193.78:0/3493378117 shutdown_connections 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 -- 10.20.193.78:0/3493378117 wait complete. 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.595+0000 7f004ffff6c0 1 Processor -- start 2026-02-13T02:42:25.598 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004ffff6c0 1 -- start start 2026-02-13T02:42:25.599 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 0x7f005011cf70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0050115270 0x7f005011d4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0050122870 0x7f0050122d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004ffff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0050123280 con 0x7f0050122870 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004ffff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f00501233f0 con 0x7f005010f060 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004ffff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00501235b0 con 0x7f0050115270 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0050122870 0x7f0050122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004e7fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0050115270 0x7f005011d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0050122870 0x7f0050122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:54308/0 (socket says 10.20.193.78:54308) 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 -- 10.20.193.78:0/2814886462 learned_addr learned my addr 10.20.193.78:0/2814886462 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:25.600 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 0x7f005011cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 -- 10.20.193.78:0/2814886462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0050115270 msgr2=0x7f005011d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0050115270 0x7f005011d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 -- 10.20.193.78:0/2814886462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 msgr2=0x7f005011cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 0x7f005011cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.596+0000 7f004f7fe6c0 1 -- 10.20.193.78:0/2814886462 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0044009590 con 0x7f0050122870 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.597+0000 7f004f7fe6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0050122870 0x7f0050122d10 secure :-1 s=READY pgs=204 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0040006ea0 tx=0x7f004000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.597+0000 7f0054a4d6c0 1 -- 10.20.193.78:0/2814886462 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0040003c40 con 0x7f0050122870 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.597+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0050163a60 con 0x7f0050122870 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.597+0000 7f0054a4d6c0 1 -- 10.20.193.78:0/2814886462 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0040003da0 con 0x7f0050122870 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.597+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0050163ef0 con 0x7f0050122870 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.597+0000 7f0054a4d6c0 1 -- 10.20.193.78:0/2814886462 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00400081c0 con 0x7f0050122870 2026-02-13T02:42:25.601 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.597+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0050110330 con 0x7f0050122870 2026-02-13T02:42:25.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.600+0000 7f0054a4d6c0 1 -- 10.20.193.78:0/2814886462 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f004000d590 con 0x7f0050122870 2026-02-13T02:42:25.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.601+0000 7f0054a4d6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00240b5760 0x7f00240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:25.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.601+0000 7f0054a4d6c0 1 -- 10.20.193.78:0/2814886462 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f00400e4d70 con 0x7f0050122870 2026-02-13T02:42:25.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.601+0000 7f004effd6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00240b5760 0x7f00240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:25.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.602+0000 7f0054a4d6c0 1 -- 10.20.193.78:0/2814886462 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00400e51f0 con 0x7f0050122870 2026-02-13T02:42:25.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.602+0000 7f004effd6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00240b5760 0x7f00240d5c10 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00440023e0 tx=0x7f0044005c60 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:25.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.724+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f005011e0c0 con 0x7f0050122870 2026-02-13T02:42:25.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.725+0000 7f0054a4d6c0 1 -- 10.20.193.78:0/2814886462 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00400a76c0 con 0x7f0050122870 2026-02-13T02:42:25.727 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:25.727 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:25.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00240b5760 msgr2=0x7f00240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:25.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00240b5760 0x7f00240d5c10 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00440023e0 tx=0x7f0044005c60 comp rx=0 tx=0).stop 2026-02-13T02:42:25.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0050122870 msgr2=0x7f0050122d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:25.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0050122870 0x7f0050122d10 secure :-1 s=READY pgs=204 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0040006ea0 tx=0x7f004000ce50 comp rx=0 tx=0).stop 2026-02-13T02:42:25.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 shutdown_connections 2026-02-13T02:42:25.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00240b5760 0x7f00240d5c10 unknown :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0050122870 0x7f0050122d10 unknown :-1 s=CLOSED pgs=204 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0050115270 0x7f005011d4b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 --2- 10.20.193.78:0/2814886462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f005010f060 0x7f005011cf70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:25.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 >> 10.20.193.78:0/2814886462 conn(0x7f00500ec980 msgr2=0x7f005010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:25.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 shutdown_connections 2026-02-13T02:42:25.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:25.726+0000 7f004ffff6c0 1 -- 10.20.193.78:0/2814886462 wait complete. 2026-02-13T02:42:26.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:26 trial091 ceph-mon[27614]: pgmap v195: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-13T02:42:26.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:26 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2814886462' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:26.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:26 trial078 ceph-mon[22944]: pgmap v195: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-13T02:42:26.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:26 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2814886462' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:27.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:26 trial154 ceph-mon[27921]: pgmap v195: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-13T02:42:27.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:26 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2814886462' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:28.830 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:28.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:28 trial078 ceph-mon[22944]: pgmap v196: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T02:42:29.015 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:29.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:28 trial154 ceph-mon[27921]: pgmap v196: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T02:42:29.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:28 trial091 ceph-mon[27614]: pgmap v196: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T02:42:29.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/236597950 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c1199a0 msgr2=0x7f379c116df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:29.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/236597950 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c1199a0 0x7f379c116df0 secure :-1 s=READY pgs=132 gs=3 cs=0 l=1 c_cookie=8135156586541921234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f378c00aa40 tx=0x7f378c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/236597950 shutdown_connections 2026-02-13T02:42:29.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/236597950 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c1199a0 0x7f379c116df0 unknown :-1 s=CLOSED pgs=132 gs=3 cs=0 l=1 c_cookie=8135156586541921234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/236597950 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f379c118f30 0x7f379c119380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/236597950 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f379c11b3f0 0x7f379c11b7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/236597950 >> 10.20.193.78:0/236597950 conn(0x7f379c05b290 msgr2=0x7f379c05b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:29.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/236597950 shutdown_connections 2026-02-13T02:42:29.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.210+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/236597950 wait complete. 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 Processor -- start 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 -- start start 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f379c118f30 0x7f379c0fdc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f379c1199a0 0x7f379c0fe160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c11b3f0 0x7f379c103520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f379c103b70 con 0x7f379c1199a0 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f379c103ce0 con 0x7f379c11b3f0 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f37a09bc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f379c103ea0 con 0x7f379c118f30 2026-02-13T02:42:29.215 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f379a5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f379c1199a0 0x7f379c0fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f379b5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c11b3f0 0x7f379c103520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f379b5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c11b3f0 0x7f379c103520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:41140/0 (socket says 10.20.193.78:41140) 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f379b5776c0 1 -- 10.20.193.78:0/993013090 learned_addr learned my addr 10.20.193.78:0/993013090 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.211+0000 7f379ad766c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f379c118f30 0x7f379c0fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f379b5776c0 1 -- 10.20.193.78:0/993013090 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f379c118f30 msgr2=0x7f379c0fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f379b5776c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f379c118f30 0x7f379c0fdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f379b5776c0 1 -- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f379c1199a0 msgr2=0x7f379c0fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f379b5776c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f379c1199a0 0x7f379c0fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f379b5776c0 1 -- 10.20.193.78:0/993013090 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c00a660 con 0x7f379c11b3f0 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f379ad766c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f379c118f30 0x7f379c0fdc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:42:29.216 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f379b5776c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c11b3f0 0x7f379c103520 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f378c00a390 tx=0x7f378c0054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:29.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f377bfff6c0 1 -- 10.20.193.78:0/993013090 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f378c003a30 con 0x7f379c11b3f0 2026-02-13T02:42:29.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379c104120 con 0x7f379c11b3f0 2026-02-13T02:42:29.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f377bfff6c0 1 -- 10.20.193.78:0/993013090 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f378c030990 con 0x7f379c11b3f0 2026-02-13T02:42:29.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f377bfff6c0 1 -- 10.20.193.78:0/993013090 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f378c0382f0 con 0x7f379c11b3f0 2026-02-13T02:42:29.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.212+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379c104840 con 0x7f379c11b3f0 2026-02-13T02:42:29.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.213+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379c05e670 con 0x7f379c11b3f0 2026-02-13T02:42:29.217 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.215+0000 7f377bfff6c0 1 -- 10.20.193.78:0/993013090 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f378c003b90 con 0x7f379c11b3f0 2026-02-13T02:42:29.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.216+0000 7f377bfff6c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f37700b5760 0x7f37700d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:29.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.216+0000 7f377bfff6c0 1 -- 10.20.193.78:0/993013090 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f378c108d60 con 0x7f379c11b3f0 2026-02-13T02:42:29.218 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.217+0000 7f377bfff6c0 1 -- 10.20.193.78:0/993013090 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f378c1091e0 con 0x7f379c11b3f0 2026-02-13T02:42:29.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.217+0000 7f379ad766c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f37700b5760 0x7f37700d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:29.219 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.217+0000 7f379ad766c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f37700b5760 0x7f37700d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3790004750 tx=0x7f3790009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:29.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.342+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f379c0fed70 con 0x7f379c11b3f0 2026-02-13T02:42:29.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.342+0000 7f377bfff6c0 1 -- 10.20.193.78:0/993013090 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f378c0cb6b0 con 0x7f379c11b3f0 2026-02-13T02:42:29.344 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:29.344 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:29.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.343+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f37700b5760 msgr2=0x7f37700d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.343+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f37700b5760 0x7f37700d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3790004750 tx=0x7f3790009260 comp rx=0 tx=0).stop 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.343+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c11b3f0 msgr2=0x7f379c103520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.343+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c11b3f0 0x7f379c103520 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f378c00a390 tx=0x7f378c0054b0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 shutdown_connections 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f37700b5760 0x7f37700d5c10 unknown :-1 s=CLOSED pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f379c11b3f0 0x7f379c103520 unknown :-1 s=CLOSED pgs=133 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f379c1199a0 0x7f379c0fe160 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 --2- 10.20.193.78:0/993013090 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f379c118f30 0x7f379c0fdc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 >> 10.20.193.78:0/993013090 conn(0x7f379c05b290 msgr2=0x7f379c0f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:29.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 shutdown_connections 2026-02-13T02:42:29.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:29.344+0000 7f37a09bc6c0 1 -- 10.20.193.78:0/993013090 wait complete. 2026-02-13T02:42:29.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:29 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/993013090' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:30.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:29 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/993013090' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:30.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:29 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/993013090' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:30.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:30 trial078 ceph-mon[22944]: pgmap v197: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2026-02-13T02:42:31.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:30 trial154 ceph-mon[27921]: pgmap v197: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2026-02-13T02:42:31.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:30 trial091 ceph-mon[27614]: pgmap v197: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2026-02-13T02:42:32.449 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:32.637 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:32.767 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:32 trial078 ceph-mon[22944]: pgmap v198: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2026-02-13T02:42:32.837 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 -- 10.20.193.78:0/1698208745 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc88810b8e0 msgr2=0x7fc88810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:32.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/1698208745 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc88810b8e0 0x7fc88810bcb0 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=17542102777561741428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc878009970 tx=0x7fc87802ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 -- 10.20.193.78:0/1698208745 shutdown_connections 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/1698208745 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc888110ef0 0x7fc888111370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/1698208745 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88810c2d0 0x7fc8881108a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/1698208745 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc88810b8e0 0x7fc88810bcb0 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=17542102777561741428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 -- 10.20.193.78:0/1698208745 >> 10.20.193.78:0/1698208745 conn(0x7fc8880e9570 msgr2=0x7fc888109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.836+0000 7fc88eed26c0 1 -- 10.20.193.78:0/1698208745 shutdown_connections 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.837+0000 7fc88eed26c0 1 -- 10.20.193.78:0/1698208745 wait complete. 2026-02-13T02:42:32.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.837+0000 7fc88eed26c0 1 Processor -- start 2026-02-13T02:42:32.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.837+0000 7fc88eed26c0 1 -- start start 2026-02-13T02:42:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.837+0000 7fc88eed26c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88810b8e0 0x7fc888121790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.837+0000 7fc88eed26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88810c2d0 0x7fc888121cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.837+0000 7fc88eed26c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc888110ef0 0x7fc888127090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88eed26c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8881276e0 con 0x7fc888110ef0 2026-02-13T02:42:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88eed26c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc888127850 con 0x7fc88810c2d0 2026-02-13T02:42:32.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88eed26c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc888127a10 con 0x7fc88810b8e0 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88ded06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88810b8e0 0x7fc888121790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88d6cf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88810c2d0 0x7fc888121cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88ded06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88810b8e0 0x7fc888121790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:44720/0 (socket says 10.20.193.78:44720) 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88ded06c0 1 -- 10.20.193.78:0/733738292 learned_addr learned my addr 10.20.193.78:0/733738292 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88e6d16c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc888110ef0 0x7fc888127090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88e6d16c0 1 -- 10.20.193.78:0/733738292 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88810b8e0 msgr2=0x7fc888121790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88e6d16c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88810b8e0 0x7fc888121790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88e6d16c0 1 -- 10.20.193.78:0/733738292 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88810c2d0 msgr2=0x7fc888121cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88e6d16c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88810c2d0 0x7fc888121cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88e6d16c0 1 -- 10.20.193.78:0/733738292 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc878009590 con 0x7fc888110ef0 2026-02-13T02:42:32.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.838+0000 7fc88e6d16c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc888110ef0 0x7fc888127090 secure :-1 s=READY pgs=206 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc884006fd0 tx=0x7fc88400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.839+0000 7fc876ffd6c0 1 -- 10.20.193.78:0/733738292 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc884003c40 con 0x7fc888110ef0 2026-02-13T02:42:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.839+0000 7fc876ffd6c0 1 -- 10.20.193.78:0/733738292 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc88400a070 con 0x7fc888110ef0 2026-02-13T02:42:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.839+0000 7fc876ffd6c0 1 -- 10.20.193.78:0/733738292 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc88400dd90 con 0x7fc888110ef0 2026-02-13T02:42:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.839+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc888127cf0 con 0x7fc888110ef0 2026-02-13T02:42:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.839+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8881683d0 con 0x7fc888110ef0 2026-02-13T02:42:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.840+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc888127f10 con 0x7fc888110ef0 2026-02-13T02:42:32.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.841+0000 7fc876ffd6c0 1 -- 10.20.193.78:0/733738292 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc884005030 con 0x7fc888110ef0 2026-02-13T02:42:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.843+0000 7fc876ffd6c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc8640b5760 0x7fc8640d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.843+0000 7fc876ffd6c0 1 -- 10.20.193.78:0/733738292 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fc8840e4ac0 con 0x7fc888110ef0 2026-02-13T02:42:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.843+0000 7fc88ded06c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc8640b5760 0x7fc8640d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.844+0000 7fc88ded06c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc8640b5760 0x7fc8640d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8780023e0 tx=0x7fc878005ea0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:32.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.844+0000 7fc876ffd6c0 1 -- 10.20.193.78:0/733738292 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8840a7410 con 0x7fc888110ef0 2026-02-13T02:42:32.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.967+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc88805fb90 con 0x7fc888110ef0 2026-02-13T02:42:32.969 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.967+0000 7fc876ffd6c0 1 -- 10.20.193.78:0/733738292 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc8840aa5c0 con 0x7fc888110ef0 2026-02-13T02:42:32.970 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:32.970 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:32.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc8640b5760 msgr2=0x7fc8640d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:32.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc8640b5760 0x7fc8640d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8780023e0 tx=0x7fc878005ea0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc888110ef0 msgr2=0x7fc888127090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:32.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc888110ef0 0x7fc888127090 secure :-1 s=READY pgs=206 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc884006fd0 tx=0x7fc88400cc00 comp rx=0 tx=0).stop 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 shutdown_connections 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc8640b5760 0x7fc8640d5c10 unknown :-1 s=CLOSED pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc888110ef0 0x7fc888127090 unknown :-1 s=CLOSED pgs=206 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88810c2d0 0x7fc888121cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 --2- 10.20.193.78:0/733738292 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88810b8e0 0x7fc888121790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 >> 10.20.193.78:0/733738292 conn(0x7fc8880e9570 msgr2=0x7fc888109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 shutdown_connections 2026-02-13T02:42:32.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:32.969+0000 7fc88eed26c0 1 -- 10.20.193.78:0/733738292 wait complete. 2026-02-13T02:42:33.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:32 trial154 ceph-mon[27921]: pgmap v198: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2026-02-13T02:42:33.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:32 trial091 ceph-mon[27614]: pgmap v198: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2026-02-13T02:42:33.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:33 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/733738292' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:34.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:33 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/733738292' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:34.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:33 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/733738292' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:34.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:34 trial078 ceph-mon[22944]: pgmap v199: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2026-02-13T02:42:35.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:34 trial154 ceph-mon[27921]: pgmap v199: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2026-02-13T02:42:35.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:34 trial091 ceph-mon[27614]: pgmap v199: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 11 op/s 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2026-02-13T02:42:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:35 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-13T02:42:36.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2026-02-13T02:42:36.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2026-02-13T02:42:36.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2026-02-13T02:42:36.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2026-02-13T02:42:36.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2026-02-13T02:42:36.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]} : dispatch 2026-02-13T02:42:36.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2026-02-13T02:42:36.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-13T02:42:36.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2026-02-13T02:42:36.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:35 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-13T02:42:36.078 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:36.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2026-02-13T02:42:36.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2026-02-13T02:42:36.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2026-02-13T02:42:36.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]} : dispatch 2026-02-13T02:42:36.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2026-02-13T02:42:36.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]} : dispatch 2026-02-13T02:42:36.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]} : dispatch 2026-02-13T02:42:36.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-13T02:42:36.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]} : dispatch 2026-02-13T02:42:36.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:35 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]} : dispatch 2026-02-13T02:42:36.264 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.460+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/2228439480 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a60118f30 msgr2=0x7f8a60119380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.460+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/2228439480 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a60118f30 0x7f8a60119380 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=589490890887541462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a54009970 tx=0x7f8a5402ed10 comp rx=0 tx=0).stop 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/2228439480 shutdown_connections 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/2228439480 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a601199a0 0x7f8a60116df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/2228439480 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a60118f30 0x7f8a60119380 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=589490890887541462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/2228439480 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a6011b3f0 0x7f8a6011b7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/2228439480 >> 10.20.193.78:0/2228439480 conn(0x7f8a6005b290 msgr2=0x7f8a6005b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:36.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/2228439480 shutdown_connections 2026-02-13T02:42:36.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/2228439480 wait complete. 2026-02-13T02:42:36.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.461+0000 7f8a66ae06c0 1 Processor -- start 2026-02-13T02:42:36.465 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a66ae06c0 1 -- start start 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a66ae06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a60118f30 0x7f8a600fdc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a66ae06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a601199a0 0x7f8a600fe1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a66ae06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a6011b3f0 0x7f8a60103570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a66ae06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a60103bc0 con 0x7f8a6011b3f0 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a66ae06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8a60103d30 con 0x7f8a601199a0 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a66ae06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a60103ef0 con 0x7f8a60118f30 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a601199a0 0x7f8a600fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a601199a0 0x7f8a600fe1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:44752/0 (socket says 10.20.193.78:44752) 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 -- 10.20.193.78:0/4269831105 learned_addr learned my addr 10.20.193.78:0/4269831105 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a65ade6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a60118f30 0x7f8a600fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:36.466 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a662df6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a6011b3f0 0x7f8a60103570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 -- 10.20.193.78:0/4269831105 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a60118f30 msgr2=0x7f8a600fdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a60118f30 0x7f8a600fdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 -- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a6011b3f0 msgr2=0x7f8a60103570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a6011b3f0 0x7f8a60103570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.462+0000 7f8a652dd6c0 1 -- 10.20.193.78:0/4269831105 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a500094c0 con 0x7f8a601199a0 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.463+0000 7f8a652dd6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a601199a0 0x7f8a600fe1b0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a54031fd0 tx=0x7f8a5402fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.463+0000 7f8a4effd6c0 1 -- 10.20.193.78:0/4269831105 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a54002ae0 con 0x7f8a601199a0 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.463+0000 7f8a4effd6c0 1 -- 10.20.193.78:0/4269831105 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8a540046b0 con 0x7f8a601199a0 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.463+0000 7f8a4effd6c0 1 -- 10.20.193.78:0/4269831105 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a54031090 con 0x7f8a601199a0 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.463+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a54009590 con 0x7f8a601199a0 2026-02-13T02:42:36.467 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.463+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a601046e0 con 0x7f8a601199a0 2026-02-13T02:42:36.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.463+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a60104410 con 0x7f8a601199a0 2026-02-13T02:42:36.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.466+0000 7f8a4effd6c0 1 -- 10.20.193.78:0/4269831105 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8a54002c40 con 0x7f8a601199a0 2026-02-13T02:42:36.469 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.468+0000 7f8a4effd6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3c0b5760 0x7f8a3c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:36.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.468+0000 7f8a4effd6c0 1 -- 10.20.193.78:0/4269831105 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8267+0+0 (secure 0 0 0) 0x7f8a54107f30 con 0x7f8a601199a0 2026-02-13T02:42:36.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.468+0000 7f8a4effd6c0 1 -- 10.20.193.78:0/4269831105 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8a541083b0 con 0x7f8a601199a0 2026-02-13T02:42:36.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.468+0000 7f8a65ade6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3c0b5760 0x7f8a3c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:36.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.468+0000 7f8a65ade6c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3c0b5760 0x7f8a3c0d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a50004750 tx=0x7f8a50009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:36.593 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.591+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8a60185ef0 con 0x7f8a601199a0 2026-02-13T02:42:36.594 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.592+0000 7f8a4effd6c0 1 -- 10.20.193.78:0/4269831105 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8a540ca750 con 0x7f8a601199a0 2026-02-13T02:42:36.594 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:36.594 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:36.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3c0b5760 msgr2=0x7f8a3c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:36.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3c0b5760 0x7f8a3c0d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a50004750 tx=0x7f8a50009260 comp rx=0 tx=0).stop 2026-02-13T02:42:36.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a601199a0 msgr2=0x7f8a600fe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:36.595 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a601199a0 0x7f8a600fe1b0 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a54031fd0 tx=0x7f8a5402fc70 comp rx=0 tx=0).stop 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 shutdown_connections 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f8a3c0b5760 0x7f8a3c0d5c10 unknown :-1 s=CLOSED pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a6011b3f0 0x7f8a60103570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8a601199a0 0x7f8a600fe1b0 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 --2- 10.20.193.78:0/4269831105 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8a60118f30 0x7f8a600fdc70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 >> 10.20.193.78:0/4269831105 conn(0x7f8a6005b290 msgr2=0x7f8a600f84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 shutdown_connections 2026-02-13T02:42:36.596 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:36.593+0000 7f8a66ae06c0 1 -- 10.20.193.78:0/4269831105 wait complete. 2026-02-13T02:42:36.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: pgmap v200: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2026-02-13T02:42:36.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2026-02-13T02:42:36.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T02:42:36.978 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:36 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4269831105' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: pgmap v200: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2026-02-13T02:42:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2026-02-13T02:42:37.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-13T02:42:37.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2026-02-13T02:42:37.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-13T02:42:37.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T02:42:37.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:36 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4269831105' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: pgmap v200: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2026-02-13T02:42:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2026-02-13T02:42:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2026-02-13T02:42:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T02:42:37.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:36 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4269831105' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:37.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:37 trial078 ceph-mon[22944]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T02:42:38.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:37 trial154 ceph-mon[27921]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T02:42:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:37 trial091 ceph-mon[27614]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T02:42:38.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:38 trial078 ceph-mon[22944]: pgmap v203: 97 pgs: 1 peering, 96 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:42:39.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:38 trial154 ceph-mon[27921]: pgmap v203: 97 pgs: 1 peering, 96 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:42:39.096 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:38 trial091 ceph-mon[27614]: pgmap v203: 97 pgs: 1 peering, 96 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:42:39.699 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:39.884 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.090+0000 7f0c38c676c0 1 -- 10.20.193.78:0/474256692 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 msgr2=0x7f0c3410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.090+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/474256692 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3410f430 secure :-1 s=READY pgs=208 gs=3 cs=0 l=1 c_cookie=15355585337892457640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c200098d0 tx=0x7f0c2002ec40 comp rx=0 tx=0).stop 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 -- 10.20.193.78:0/474256692 shutdown_connections 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/474256692 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0c34115270 0x7f0c34175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/474256692 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0c3410fa50 0x7f0c34114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/474256692 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3410f430 unknown :-1 s=CLOSED pgs=208 gs=3 cs=0 l=1 c_cookie=15355585337892457640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 -- 10.20.193.78:0/474256692 >> 10.20.193.78:0/474256692 conn(0x7f0c340ec980 msgr2=0x7f0c3410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:40.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 -- 10.20.193.78:0/474256692 shutdown_connections 2026-02-13T02:42:40.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 -- 10.20.193.78:0/474256692 wait complete. 2026-02-13T02:42:40.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.091+0000 7f0c38c676c0 1 Processor -- start 2026-02-13T02:42:40.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c38c676c0 1 -- start start 2026-02-13T02:42:40.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c38c676c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3411d050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:40.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c38c676c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0c34115270 0x7f0c3411d590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:40.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c38c676c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0c34122950 0x7f0c34122df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:40.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c38c676c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34123360 con 0x7f0c3410f060 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c38c676c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0c341234d0 con 0x7f0c34122950 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c38c676c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34123690 con 0x7f0c34115270 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3411d050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c32ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0c34115270 0x7f0c3411d590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3411d050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:60648/0 (socket says 10.20.193.78:60648) 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 -- 10.20.193.78:0/3782497686 learned_addr learned my addr 10.20.193.78:0/3782497686 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c33fff6c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0c34122950 0x7f0c34122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 -- 10.20.193.78:0/3782497686 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0c34115270 msgr2=0x7f0c3411d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0c34115270 0x7f0c3411d590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 -- 10.20.193.78:0/3782497686 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0c34122950 msgr2=0x7f0c34122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0c34122950 0x7f0c34122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 -- 10.20.193.78:0/3782497686 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c24009590 con 0x7f0c3410f060 2026-02-13T02:42:40.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c32ffd6c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0c34115270 0x7f0c3411d590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:42:40.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.092+0000 7f0c337fe6c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3411d050 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c200023a0 tx=0x7f0c2002fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:40.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.093+0000 7f0c30ff96c0 1 -- 10.20.193.78:0/3782497686 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c20002ae0 con 0x7f0c3410f060 2026-02-13T02:42:40.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.093+0000 7f0c30ff96c0 1 -- 10.20.193.78:0/3782497686 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0c20002c40 con 0x7f0c3410f060 2026-02-13T02:42:40.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.093+0000 7f0c30ff96c0 1 -- 10.20.193.78:0/3782497686 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0c200312b0 con 0x7f0c3410f060 2026-02-13T02:42:40.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.093+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c200094c0 con 0x7f0c3410f060 2026-02-13T02:42:40.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.093+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c34163d50 con 0x7f0c3410f060 2026-02-13T02:42:40.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.093+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c34110330 con 0x7f0c3410f060 2026-02-13T02:42:40.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.096+0000 7f0c30ff96c0 1 -- 10.20.193.78:0/3782497686 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0c200071c0 con 0x7f0c3410f060 2026-02-13T02:42:40.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.097+0000 7f0c30ff96c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0c080b5760 0x7f0c080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:40.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.098+0000 7f0c32ffd6c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0c080b5760 0x7f0c080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:40.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.098+0000 7f0c30ff96c0 1 -- 10.20.193.78:0/3782497686 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f0c20107e40 con 0x7f0c3410f060 2026-02-13T02:42:40.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.098+0000 7f0c30ff96c0 1 -- 10.20.193.78:0/3782497686 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0c201082c0 con 0x7f0c3410f060 2026-02-13T02:42:40.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.098+0000 7f0c32ffd6c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0c080b5760 0x7f0c080d5c10 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c341239e0 tx=0x7f0c24009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:40.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.221+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0c3410fa50 con 0x7f0c3410f060 2026-02-13T02:42:40.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.221+0000 7f0c30ff96c0 1 -- 10.20.193.78:0/3782497686 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0c200ca660 con 0x7f0c3410f060 2026-02-13T02:42:40.223 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:40.224 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0c080b5760 msgr2=0x7f0c080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0c080b5760 0x7f0c080d5c10 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c341239e0 tx=0x7f0c24009310 comp rx=0 tx=0).stop 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 msgr2=0x7f0c3411d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3411d050 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c200023a0 tx=0x7f0c2002fba0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 shutdown_connections 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0c080b5760 0x7f0c080d5c10 unknown :-1 s=CLOSED pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0c34122950 0x7f0c34122df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0c34115270 0x7f0c3411d590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.225 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 --2- 10.20.193.78:0/3782497686 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c3410f060 0x7f0c3411d050 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:40.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 >> 10.20.193.78:0/3782497686 conn(0x7f0c340ec980 msgr2=0x7f0c3410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:40.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 shutdown_connections 2026-02-13T02:42:40.226 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:40.222+0000 7f0c38c676c0 1 -- 10.20.193.78:0/3782497686 wait complete. 2026-02-13T02:42:40.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:40 trial078 ceph-mon[22944]: pgmap v204: 97 pgs: 1 peering, 96 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:40.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:40 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3782497686' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:41.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:40 trial154 ceph-mon[27921]: pgmap v204: 97 pgs: 1 peering, 96 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:41.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:40 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3782497686' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:41.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:40 trial091 ceph-mon[27614]: pgmap v204: 97 pgs: 1 peering, 96 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:41.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:40 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3782497686' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:42.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:42 trial078 ceph-mon[22944]: pgmap v205: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 7 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:43.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:42 trial154 ceph-mon[27921]: pgmap v205: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 7 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:43.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:42 trial091 ceph-mon[27614]: pgmap v205: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 7 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:43.333 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:43.519 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:43.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 -- 10.20.193.78:0/1431455455 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9f1410fbf0 msgr2=0x7f9f14114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:43.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 --2- 10.20.193.78:0/1431455455 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9f1410fbf0 0x7f9f14114c30 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=16991497817701797962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f040099a0 tx=0x7f9f0402ed00 comp rx=0 tx=0).stop 2026-02-13T02:42:43.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 -- 10.20.193.78:0/1431455455 shutdown_connections 2026-02-13T02:42:43.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 --2- 10.20.193.78:0/1431455455 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9f14115410 0x7f9f14175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 --2- 10.20.193.78:0/1431455455 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9f1410fbf0 0x7f9f14114c30 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=16991497817701797962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 --2- 10.20.193.78:0/1431455455 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 0x7f9f1410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 -- 10.20.193.78:0/1431455455 >> 10.20.193.78:0/1431455455 conn(0x7f9f140ecb00 msgr2=0x7f9f1410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:43.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 -- 10.20.193.78:0/1431455455 shutdown_connections 2026-02-13T02:42:43.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.708+0000 7f9f19ffc6c0 1 -- 10.20.193.78:0/1431455455 wait complete. 2026-02-13T02:42:43.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 Processor -- start 2026-02-13T02:42:43.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 -- start start 2026-02-13T02:42:43.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 0x7f9f14066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:43.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9f14115410 0x7f9f14175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9f14062990 0x7f9f14062e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9f140635a0 con 0x7f9f14062990 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9f14063710 con 0x7f9f1410f200 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f19ffc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f140ff350 con 0x7f9f14115410 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f137fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 0x7f9f14066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f137fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 0x7f9f14066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:44794/0 (socket says 10.20.193.78:44794) 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f137fe6c0 1 -- 10.20.193.78:0/2086182322 learned_addr learned my addr 10.20.193.78:0/2086182322 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.709+0000 7f9f13fff6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9f14062990 0x7f9f14062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f137fe6c0 1 -- 10.20.193.78:0/2086182322 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9f14115410 msgr2=0x7f9f14175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:43.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f137fe6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9f14115410 0x7f9f14175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f137fe6c0 1 -- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9f14062990 msgr2=0x7f9f14062e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f137fe6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9f14062990 0x7f9f14062e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f137fe6c0 1 -- 10.20.193.78:0/2086182322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0800a5b0 con 0x7f9f1410f200 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f137fe6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 0x7f9f14066730 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f00009490 tx=0x7f9f0000bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f10ff96c0 1 -- 10.20.193.78:0/2086182322 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f00004a80 con 0x7f9f1410f200 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f19ffc6c0 1 -- 10.20.193.78:0/2086182322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f04009590 con 0x7f9f1410f200 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f10ff96c0 1 -- 10.20.193.78:0/2086182322 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9f00009030 con 0x7f9f1410f200 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f10ff96c0 1 -- 10.20.193.78:0/2086182322 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f0000ce70 con 0x7f9f1410f200 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.710+0000 7f9f19ffc6c0 1 -- 10.20.193.78:0/2086182322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f140ff930 con 0x7f9f1410f200 2026-02-13T02:42:43.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.711+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f141104d0 con 0x7f9f1410f200 2026-02-13T02:42:43.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.713+0000 7f9f10ff96c0 1 -- 10.20.193.78:0/2086182322 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9f00004060 con 0x7f9f1410f200 2026-02-13T02:42:43.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.714+0000 7f9f10ff96c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9ee80b56e0 0x7f9ee80d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:43.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.714+0000 7f9f10ff96c0 1 -- 10.20.193.78:0/2086182322 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f9f000e3d80 con 0x7f9f1410f200 2026-02-13T02:42:43.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.715+0000 7f9f10ff96c0 1 -- 10.20.193.78:0/2086182322 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9f000e4200 con 0x7f9f1410f200 2026-02-13T02:42:43.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.715+0000 7f9f12ffd6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9ee80b56e0 0x7f9ee80d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:43.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.715+0000 7f9f12ffd6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9ee80b56e0 0x7f9ee80d5b90 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f040098c0 tx=0x7f9f04005be0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:43.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.849+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9f1410f5d0 con 0x7f9f1410f200 2026-02-13T02:42:43.851 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.849+0000 7f9f10ff96c0 1 -- 10.20.193.78:0/2086182322 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9f000a65a0 con 0x7f9f1410f200 2026-02-13T02:42:43.852 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:43.852 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:43.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.850+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9ee80b56e0 msgr2=0x7f9ee80d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:43.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.850+0000 7f9eee7fc6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9ee80b56e0 0x7f9ee80d5b90 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f040098c0 tx=0x7f9f04005be0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.850+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 msgr2=0x7f9f14066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:43.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.850+0000 7f9eee7fc6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 0x7f9f14066730 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f00009490 tx=0x7f9f0000bc50 comp rx=0 tx=0).stop 2026-02-13T02:42:43.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 shutdown_connections 2026-02-13T02:42:43.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9ee80b56e0 0x7f9ee80d5b90 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9f14062990 0x7f9f14062e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9f14115410 0x7f9f14175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 --2- 10.20.193.78:0/2086182322 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9f1410f200 0x7f9f14066730 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:43.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 >> 10.20.193.78:0/2086182322 conn(0x7f9f140ecb00 msgr2=0x7f9f14113bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:43.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 shutdown_connections 2026-02-13T02:42:43.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:43.851+0000 7f9eee7fc6c0 1 -- 10.20.193.78:0/2086182322 wait complete. 2026-02-13T02:42:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:44 trial078 ceph-mon[22944]: pgmap v206: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:44.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:44 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2086182322' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:44 trial154 ceph-mon[27921]: pgmap v206: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:44 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2086182322' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:45.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:44 trial091 ceph-mon[27614]: pgmap v206: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T02:42:45.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:44 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2086182322' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:46.958 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:47.010 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:46 trial078 ceph-mon[22944]: pgmap v207: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 9 op/s; 69 B/s, 1 objects/s recovering 2026-02-13T02:42:47.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:46 trial154 ceph-mon[27921]: pgmap v207: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 9 op/s; 69 B/s, 1 objects/s recovering 2026-02-13T02:42:47.144 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:47.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:46 trial091 ceph-mon[27614]: pgmap v207: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 9 op/s; 69 B/s, 1 objects/s recovering 2026-02-13T02:42:47.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2492071083 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10114190 msgr2=0x7f6a10115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2492071083 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10114190 0x7f6a10115d40 secure :-1 s=READY pgs=136 gs=2 cs=0 l=1 c_cookie=2270442027962723503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a00009970 tx=0x7f6a0002ed10 comp rx=0 tx=0).stop 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2492071083 shutdown_connections 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2492071083 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a10116520 0x7f6a1017a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2492071083 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10114190 0x7f6a10115d40 unknown :-1 s=CLOSED pgs=136 gs=2 cs=0 l=1 c_cookie=2270442027962723503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2492071083 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6a101137a0 0x7f6a10113b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2492071083 >> 10.20.193.78:0/2492071083 conn(0x7f6a10061510 msgr2=0x7f6a10061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2492071083 shutdown_connections 2026-02-13T02:42:47.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.346+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2492071083 wait complete. 2026-02-13T02:42:47.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 Processor -- start 2026-02-13T02:42:47.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 -- start start 2026-02-13T02:42:47.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a101137a0 0x7f6a101214c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:47.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6a10116520 0x7f6a10121a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:47.351 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10126dc0 0x7f6a10127260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6a101277d0 con 0x7f6a10116520 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10127940 con 0x7f6a10126dc0 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a14edf6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a10127b00 con 0x7f6a101137a0 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.347+0000 7f6a0ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10126dc0 0x7f6a10127260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10126dc0 0x7f6a10127260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:36368/0 (socket says 10.20.193.78:36368) 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0ffff6c0 1 -- 10.20.193.78:0/2725286812 learned_addr learned my addr 10.20.193.78:0/2725286812 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0f7fe6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a101137a0 0x7f6a101214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0effd6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6a10116520 0x7f6a10121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0effd6c0 1 -- 10.20.193.78:0/2725286812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a101137a0 msgr2=0x7f6a101214c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0effd6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a101137a0 0x7f6a101214c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.352 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0effd6c0 1 -- 10.20.193.78:0/2725286812 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10126dc0 msgr2=0x7f6a10127260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0effd6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10126dc0 0x7f6a10127260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0effd6c0 1 -- 10.20.193.78:0/2725286812 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a00009590 con 0x7f6a10116520 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0effd6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6a10116520 0x7f6a10121a00 secure :-1 s=READY pgs=210 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a00009970 tx=0x7f6a0002f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0cff96c0 1 -- 10.20.193.78:0/2725286812 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a000028d0 con 0x7f6a10116520 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a10167f50 con 0x7f6a10116520 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a101683a0 con 0x7f6a10116520 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0cff96c0 1 -- 10.20.193.78:0/2725286812 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6a00007740 con 0x7f6a10116520 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.348+0000 7f6a0cff96c0 1 -- 10.20.193.78:0/2725286812 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a00002c50 con 0x7f6a10116520 2026-02-13T02:42:47.353 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.349+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10114840 con 0x7f6a10116520 2026-02-13T02:42:47.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.351+0000 7f6a0cff96c0 1 -- 10.20.193.78:0/2725286812 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6a000078b0 con 0x7f6a10116520 2026-02-13T02:42:47.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.352+0000 7f6a0cff96c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f69e40b5760 0x7f69e40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:47.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.352+0000 7f6a0cff96c0 1 -- 10.20.193.78:0/2725286812 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f6a00107d00 con 0x7f6a10116520 2026-02-13T02:42:47.354 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.353+0000 7f6a0cff96c0 1 -- 10.20.193.78:0/2725286812 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6a00108180 con 0x7f6a10116520 2026-02-13T02:42:47.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.353+0000 7f6a0f7fe6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f69e40b5760 0x7f69e40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:47.355 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.353+0000 7f6a0f7fe6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f69e40b5760 0x7f69e40d5c10 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69fc004750 tx=0x7f69fc009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:47.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.477+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6a10113b70 con 0x7f6a10116520 2026-02-13T02:42:47.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.477+0000 7f6a0cff96c0 1 -- 10.20.193.78:0/2725286812 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6a000ca520 con 0x7f6a10116520 2026-02-13T02:42:47.479 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:47.479 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:47.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f69e40b5760 msgr2=0x7f69e40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f69e40b5760 0x7f69e40d5c10 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69fc004750 tx=0x7f69fc009260 comp rx=0 tx=0).stop 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6a10116520 msgr2=0x7f6a10121a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6a10116520 0x7f6a10121a00 secure :-1 s=READY pgs=210 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a00009970 tx=0x7f6a0002f9f0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 shutdown_connections 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f69e40b5760 0x7f69e40d5c10 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a10126dc0 0x7f6a10127260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6a10116520 0x7f6a10121a00 unknown :-1 s=CLOSED pgs=210 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 --2- 10.20.193.78:0/2725286812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a101137a0 0x7f6a101214c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 >> 10.20.193.78:0/2725286812 conn(0x7f6a10061510 msgr2=0x7f6a10114d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 shutdown_connections 2026-02-13T02:42:47.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:47.478+0000 7f6a14edf6c0 1 -- 10.20.193.78:0/2725286812 wait complete. 2026-02-13T02:42:47.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:47 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2725286812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:48.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:47 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2725286812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:48.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:47 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2725286812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:48 trial154 ceph-mon[27921]: pgmap v208: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 11 op/s; 63 B/s, 1 objects/s recovering 2026-02-13T02:42:49.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:48 trial091 ceph-mon[27614]: pgmap v208: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 11 op/s; 63 B/s, 1 objects/s recovering 2026-02-13T02:42:49.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:48 trial078 ceph-mon[22944]: pgmap v208: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 11 op/s; 63 B/s, 1 objects/s recovering 2026-02-13T02:42:50.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:49 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:42:50.047 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:49 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:42:50.208 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:49 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:42:50.583 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:50.771 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:50.901 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:50 trial078 ceph-mon[22944]: pgmap v209: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 8 op/s; 57 B/s, 0 objects/s recovering 2026-02-13T02:42:50.901 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:50.901 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:50.901 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:50.901 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:50 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:50.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 -- 10.20.193.78:0/1169700136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c11bba0 msgr2=0x7fb67c17c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 --2- 10.20.193.78:0/1169700136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c11bba0 0x7fb67c17c540 secure :-1 s=READY pgs=137 gs=2 cs=0 l=1 c_cookie=14826162180031976046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb66c00aa40 tx=0x7fb66c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 -- 10.20.193.78:0/1169700136 shutdown_connections 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 --2- 10.20.193.78:0/1169700136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c11bba0 0x7fb67c17c540 unknown :-1 s=CLOSED pgs=137 gs=2 cs=0 l=1 c_cookie=14826162180031976046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 --2- 10.20.193.78:0/1169700136 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c116380 0x7fb67c11b3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 --2- 10.20.193.78:0/1169700136 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb67c115990 0x7fb67c115d60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 -- 10.20.193.78:0/1169700136 >> 10.20.193.78:0/1169700136 conn(0x7fb67c05e060 msgr2=0x7fb67c05e460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 -- 10.20.193.78:0/1169700136 shutdown_connections 2026-02-13T02:42:50.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.968+0000 7fb6814396c0 1 -- 10.20.193.78:0/1169700136 wait complete. 2026-02-13T02:42:50.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.969+0000 7fb6814396c0 1 Processor -- start 2026-02-13T02:42:50.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.969+0000 7fb6814396c0 1 -- start start 2026-02-13T02:42:50.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb6814396c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c115990 0x7fb67c123850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:50.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb6814396c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb67c11bba0 0x7fb67c123d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:50.973 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb6814396c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c129150 0x7fb67c1295f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb6814396c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c129b60 con 0x7fb67c11bba0 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb6814396c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c129cd0 con 0x7fb67c129150 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb6814396c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb67c129e90 con 0x7fb67c115990 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c115990 0x7fb67c123850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c115990 0x7fb67c123850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49884/0 (socket says 10.20.193.78:49884) 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 -- 10.20.193.78:0/4277409795 learned_addr learned my addr 10.20.193.78:0/4277409795 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67b7fe6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c129150 0x7fb67c1295f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 -- 10.20.193.78:0/4277409795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c129150 msgr2=0x7fb67c1295f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c129150 0x7fb67c1295f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 -- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb67c11bba0 msgr2=0x7fb67c123d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb67c11bba0 0x7fb67c123d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:50.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 -- 10.20.193.78:0/4277409795 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c00a660 con 0x7fb67c115990 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb67affd6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c115990 0x7fb67c123850 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb670009490 tx=0x7fb67000bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.970+0000 7fb65bfff6c0 1 -- 10.20.193.78:0/4277409795 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb670004a80 con 0x7fb67c115990 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.971+0000 7fb6814396c0 1 -- 10.20.193.78:0/4277409795 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c16a340 con 0x7fb67c115990 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.971+0000 7fb65bfff6c0 1 -- 10.20.193.78:0/4277409795 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb670009030 con 0x7fb67c115990 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.971+0000 7fb65bfff6c0 1 -- 10.20.193.78:0/4277409795 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb6700071c0 con 0x7fb67c115990 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.971+0000 7fb6814396c0 1 -- 10.20.193.78:0/4277409795 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb67c16a820 con 0x7fb67c115990 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.971+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c116c60 con 0x7fb67c115990 2026-02-13T02:42:50.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.974+0000 7fb65bfff6c0 1 -- 10.20.193.78:0/4277409795 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fb670004ce0 con 0x7fb67c115990 2026-02-13T02:42:50.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.975+0000 7fb65bfff6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb6500b57e0 0x7fb6500d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:50.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.975+0000 7fb65bfff6c0 1 -- 10.20.193.78:0/4277409795 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7fb6700e3de0 con 0x7fb67c115990 2026-02-13T02:42:50.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.975+0000 7fb67a7fc6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb6500b57e0 0x7fb6500d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:50.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.975+0000 7fb65bfff6c0 1 -- 10.20.193.78:0/4277409795 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb6700a6600 con 0x7fb67c115990 2026-02-13T02:42:50.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:50.976+0000 7fb67a7fc6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb6500b57e0 0x7fb6500d5c90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67c12a1e0 tx=0x7fb6640096a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:50 trial154 ceph-mon[27921]: pgmap v209: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 8 op/s; 57 B/s, 0 objects/s recovering 2026-02-13T02:42:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:50 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.100+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb67c115d60 con 0x7fb67c115990 2026-02-13T02:42:51.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.100+0000 7fb65bfff6c0 1 -- 10.20.193.78:0/4277409795 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb6700a97b0 con 0x7fb67c115990 2026-02-13T02:42:51.102 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:51.102 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:51.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb6500b57e0 msgr2=0x7fb6500d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:51.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb6500b57e0 0x7fb6500d5c90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb67c12a1e0 tx=0x7fb6640096a0 comp rx=0 tx=0).stop 2026-02-13T02:42:51.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c115990 msgr2=0x7fb67c123850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:51.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c115990 0x7fb67c123850 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb670009490 tx=0x7fb67000bca0 comp rx=0 tx=0).stop 2026-02-13T02:42:51.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 shutdown_connections 2026-02-13T02:42:51.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb6500b57e0 0x7fb6500d5c90 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:51.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb67c129150 0x7fb67c1295f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:51.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb67c11bba0 0x7fb67c123d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:51.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 --2- 10.20.193.78:0/4277409795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb67c115990 0x7fb67c123850 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:51.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 >> 10.20.193.78:0/4277409795 conn(0x7fb67c05e060 msgr2=0x7fb67c117150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:51.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 shutdown_connections 2026-02-13T02:42:51.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:51.102+0000 7fb659ffb6c0 1 -- 10.20.193.78:0/4277409795 wait complete. 2026-02-13T02:42:51.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:50 trial091 ceph-mon[27614]: pgmap v209: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 8 op/s; 57 B/s, 0 objects/s recovering 2026-02-13T02:42:51.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:50 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.974 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.975 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:51.975 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4277409795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:51.975 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: pgmap v210: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:42:52.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:52.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:52.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4277409795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:52.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: pgmap v210: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:42:52.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:42:52.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:42:52.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:52.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:42:52.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: pgmap v211: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T02:42:52.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:42:52.229 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:51 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:42:52.236 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:52.236 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4277409795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: pgmap v210: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: pgmap v211: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:42:52.237 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:51 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:42:52.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:42:52.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:42:52.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:42:52.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:42:52.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: pgmap v211: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T02:42:52.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:42:52.446 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:51 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:42:53.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:52 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:42:53.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:52 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:42:53.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:52 trial078 ceph-mon[22944]: pgmap v212: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:42:53.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:52 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:42:53.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:52 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:42:53.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:52 trial154 ceph-mon[27921]: pgmap v212: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:42:53.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:52 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:42:53.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:52 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:42:53.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:52 trial091 ceph-mon[27614]: pgmap v212: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:42:54.206 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:54.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:53 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:42:54.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:53 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:42:54.395 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:54.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:53 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:42:54.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 -- 10.20.193.78:0/1876784524 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b810fa50 msgr2=0x7f76b8114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:54.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1876784524 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b810fa50 0x7f76b8114a90 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=12895198279988029764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76a0009970 tx=0x7f76a002ed50 comp rx=0 tx=0).stop 2026-02-13T02:42:54.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 -- 10.20.193.78:0/1876784524 shutdown_connections 2026-02-13T02:42:54.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1876784524 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76b8115270 0x7f76b8175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1876784524 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b810fa50 0x7f76b8114a90 unknown :-1 s=CLOSED pgs=138 gs=2 cs=0 l=1 c_cookie=12895198279988029764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1876784524 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f76b810f060 0x7f76b810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.606 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 -- 10.20.193.78:0/1876784524 >> 10.20.193.78:0/1876784524 conn(0x7f76b80ec980 msgr2=0x7f76b810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:54.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 -- 10.20.193.78:0/1876784524 shutdown_connections 2026-02-13T02:42:54.607 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.603+0000 7f76b75776c0 1 -- 10.20.193.78:0/1876784524 wait complete. 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.604+0000 7f76b75776c0 1 Processor -- start 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.604+0000 7f76b75776c0 1 -- start start 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b75776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f76b810f060 0x7f76b80f4910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b75776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b8115270 0x7f76b8175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b75776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76b80f4f40 0x7f76b80fa210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b8115270 0x7f76b8175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b75776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80f5630 con 0x7f76b810f060 2026-02-13T02:42:54.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b75776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80fa750 con 0x7f76b8115270 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b75776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80fa910 con 0x7f76b80f4f40 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b8115270 0x7f76b8175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:36392/0 (socket says 10.20.193.78:36392) 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 -- 10.20.193.78:0/1462127355 learned_addr learned my addr 10.20.193.78:0/1462127355 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 -- 10.20.193.78:0/1462127355 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76b80f4f40 msgr2=0x7f76b80fa210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76b80f4f40 0x7f76b80fa210 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 -- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f76b810f060 msgr2=0x7f76b80f4910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b65756c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f76b810f060 0x7f76b80f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f76b810f060 0x7f76b80f4910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.605+0000 7f76b5d746c0 1 -- 10.20.193.78:0/1462127355 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ac0094c0 con 0x7f76b8115270 2026-02-13T02:42:54.610 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.606+0000 7f76b5d746c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b8115270 0x7f76b8175b10 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76a00098c0 tx=0x7f76a002fca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:54.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.606+0000 7f769f7fe6c0 1 -- 10.20.193.78:0/1462127355 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76a0002ae0 con 0x7f76b8115270 2026-02-13T02:42:54.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.606+0000 7f769f7fe6c0 1 -- 10.20.193.78:0/1462127355 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f76a0002c40 con 0x7f76b8115270 2026-02-13T02:42:54.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.606+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a0009590 con 0x7f76b8115270 2026-02-13T02:42:54.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.606+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b80fae80 con 0x7f76b8115270 2026-02-13T02:42:54.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.606+0000 7f769f7fe6c0 1 -- 10.20.193.78:0/1462127355 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76a00362f0 con 0x7f76b8115270 2026-02-13T02:42:54.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.606+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b8110330 con 0x7f76b8115270 2026-02-13T02:42:54.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.609+0000 7f769f7fe6c0 1 -- 10.20.193.78:0/1462127355 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f76a0007260 con 0x7f76b8115270 2026-02-13T02:42:54.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.611+0000 7f769f7fe6c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f76900b56e0 0x7f76900d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:54.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.611+0000 7f769f7fe6c0 1 -- 10.20.193.78:0/1462127355 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f76a0107f40 con 0x7f76b8115270 2026-02-13T02:42:54.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.611+0000 7f769f7fe6c0 1 -- 10.20.193.78:0/1462127355 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f76a01083c0 con 0x7f76b8115270 2026-02-13T02:42:54.613 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.611+0000 7f76b65756c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f76900b56e0 0x7f76900d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:54.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.612+0000 7f76b65756c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f76900b56e0 0x7f76900d5b90 secure :-1 s=READY pgs=198 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76ac004750 tx=0x7f76ac009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:54.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.735+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f76b80fb010 con 0x7f76b8115270 2026-02-13T02:42:54.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.735+0000 7f769f7fe6c0 1 -- 10.20.193.78:0/1462127355 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f76a00ca760 con 0x7f76b8115270 2026-02-13T02:42:54.737 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:54.738 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.736+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f76900b56e0 msgr2=0x7f76900d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.736+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f76900b56e0 0x7f76900d5b90 secure :-1 s=READY pgs=198 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76ac004750 tx=0x7f76ac009260 comp rx=0 tx=0).stop 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.736+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b8115270 msgr2=0x7f76b8175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.736+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b8115270 0x7f76b8175b10 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76a00098c0 tx=0x7f76a002fca0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 shutdown_connections 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f76900b56e0 0x7f76900d5b90 unknown :-1 s=CLOSED pgs=198 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76b80f4f40 0x7f76b80fa210 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76b8115270 0x7f76b8175b10 unknown :-1 s=CLOSED pgs=139 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 --2- 10.20.193.78:0/1462127355 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f76b810f060 0x7f76b80f4910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:54.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 >> 10.20.193.78:0/1462127355 conn(0x7f76b80ec980 msgr2=0x7f76b810d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:54.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 shutdown_connections 2026-02-13T02:42:54.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:54.737+0000 7f76b75776c0 1 -- 10.20.193.78:0/1462127355 wait complete. 2026-02-13T02:42:55.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:54 trial078 ceph-mon[22944]: pgmap v213: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:42:55.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:54 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1462127355' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:55.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:54 trial154 ceph-mon[27921]: pgmap v213: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:42:55.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:54 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1462127355' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:55.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:54 trial091 ceph-mon[27614]: pgmap v213: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:42:55.445 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:54 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1462127355' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:57.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:57 trial091 ceph-mon[27614]: pgmap v214: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T02:42:57.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:57 trial078 ceph-mon[22944]: pgmap v214: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T02:42:57.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:57 trial154 ceph-mon[27921]: pgmap v214: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T02:42:57.844 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:42:58.031 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 -- 10.20.193.78:0/903588671 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810fa50 msgr2=0x7f7188114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 --2- 10.20.193.78:0/903588671 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810fa50 0x7f7188114a90 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=5559940643578129007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717c0098d0 tx=0x7f717c02ec30 comp rx=0 tx=0).stop 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 -- 10.20.193.78:0/903588671 shutdown_connections 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 --2- 10.20.193.78:0/903588671 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7188115270 0x7f7188175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 --2- 10.20.193.78:0/903588671 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810fa50 0x7f7188114a90 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=5559940643578129007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 --2- 10.20.193.78:0/903588671 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f718810f060 0x7f718810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 -- 10.20.193.78:0/903588671 >> 10.20.193.78:0/903588671 conn(0x7f71880ec980 msgr2=0x7f718810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.236+0000 7f718e8676c0 1 -- 10.20.193.78:0/903588671 shutdown_connections 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.237+0000 7f718e8676c0 1 -- 10.20.193.78:0/903588671 wait complete. 2026-02-13T02:42:58.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.237+0000 7f718e8676c0 1 Processor -- start 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.237+0000 7f718e8676c0 1 -- start start 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810f060 0x7f7188066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7188115270 0x7f7188175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7188062990 0x7f7188062e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f71880635a0 con 0x7f718810f060 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7188063710 con 0x7f7188062990 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71880ff1d0 con 0x7f7188115270 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810f060 0x7f7188066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810f060 0x7f7188066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:43920/0 (socket says 10.20.193.78:43920) 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 -- 10.20.193.78:0/3373865043 learned_addr learned my addr 10.20.193.78:0/3373865043 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d0646c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7188115270 0x7f7188175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e0666c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7188062990 0x7f7188062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 -- 10.20.193.78:0/3373865043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7188115270 msgr2=0x7f7188175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:58.239 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7188115270 0x7f7188175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 -- 10.20.193.78:0/3373865043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7188062990 msgr2=0x7f7188062e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7188062990 0x7f7188062e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 -- 10.20.193.78:0/3373865043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c0094c0 con 0x7f718810f060 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718d8656c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810f060 0x7f7188066730 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7178005950 tx=0x7f717800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f7176ffd6c0 1 -- 10.20.193.78:0/3373865043 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7178004460 con 0x7f718810f060 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f7176ffd6c0 1 -- 10.20.193.78:0/3373865043 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f71780045c0 con 0x7f718810f060 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f7176ffd6c0 1 -- 10.20.193.78:0/3373865043 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7178003960 con 0x7f718810f060 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71880ff4b0 con 0x7f718810f060 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.238+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71880ff940 con 0x7f718810f060 2026-02-13T02:42:58.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.239+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7188110330 con 0x7f718810f060 2026-02-13T02:42:58.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.241+0000 7f7176ffd6c0 1 -- 10.20.193.78:0/3373865043 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f71780050b0 con 0x7f718810f060 2026-02-13T02:42:58.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.243+0000 7f7176ffd6c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71640b5760 0x7f71640d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:42:58.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.243+0000 7f7176ffd6c0 1 -- 10.20.193.78:0/3373865043 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f71780e3c50 con 0x7f718810f060 2026-02-13T02:42:58.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.243+0000 7f7176ffd6c0 1 -- 10.20.193.78:0/3373865043 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f71780e4140 con 0x7f718810f060 2026-02-13T02:42:58.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.243+0000 7f718d0646c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71640b5760 0x7f71640d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:42:58.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.243+0000 7f718d0646c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71640b5760 0x7f71640d5c10 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7188110940 tx=0x7f717c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:42:58.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.368+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f718810f430 con 0x7f718810f060 2026-02-13T02:42:58.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.368+0000 7f7176ffd6c0 1 -- 10.20.193.78:0/3373865043 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f71780a64b0 con 0x7f718810f060 2026-02-13T02:42:58.369 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:42:58.369 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:42:58.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71640b5760 msgr2=0x7f71640d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:58.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71640b5760 0x7f71640d5c10 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7188110940 tx=0x7f717c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810f060 msgr2=0x7f7188066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810f060 0x7f7188066730 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7178005950 tx=0x7f717800bca0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 shutdown_connections 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71640b5760 0x7f71640d5c10 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7188062990 0x7f7188062e10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7188115270 0x7f7188175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 --2- 10.20.193.78:0/3373865043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f718810f060 0x7f7188066730 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 >> 10.20.193.78:0/3373865043 conn(0x7f71880ec980 msgr2=0x7f7188113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 shutdown_connections 2026-02-13T02:42:58.371 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:42:58.369+0000 7f718e8676c0 1 -- 10.20.193.78:0/3373865043 wait complete. 2026-02-13T02:42:58.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:58 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3373865043' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:58.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:58 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3373865043' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:58.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:58 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3373865043' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:42:59.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:42:59 trial091 ceph-mon[27614]: pgmap v215: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:42:59.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:42:59 trial078 ceph-mon[22944]: pgmap v215: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:42:59.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:42:59 trial154 ceph-mon[27921]: pgmap v215: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:43:01.474 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:01.658 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:01.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:01 trial091 ceph-mon[27614]: pgmap v216: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:43:01.700 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:01 trial078 ceph-mon[22944]: pgmap v216: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:43:01.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:01 trial154 ceph-mon[27921]: pgmap v216: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:43:01.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1392450934 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8840110ef0 msgr2=0x7f8840111370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1392450934 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8840110ef0 0x7f8840111370 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=9701691783567380359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f883400aa40 tx=0x7f883402fde0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1392450934 shutdown_connections 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1392450934 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8840110ef0 0x7f8840111370 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=9701691783567380359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1392450934 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010c2d0 0x7f88401108a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1392450934 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f884010b8e0 0x7f884010bcb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1392450934 >> 10.20.193.78:0/1392450934 conn(0x7f88400e9570 msgr2=0x7f8840109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1392450934 shutdown_connections 2026-02-13T02:43:01.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.861+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1392450934 wait complete. 2026-02-13T02:43:01.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 Processor -- start 2026-02-13T02:43:01.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 -- start start 2026-02-13T02:43:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010b8e0 0x7f88401217f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f884010c2d0 0x7f8840121d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8840110ef0 0x7f88401270f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8840127740 con 0x7f8840110ef0 2026-02-13T02:43:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f88401278b0 con 0x7f884010b8e0 2026-02-13T02:43:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f88457ff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8840127a70 con 0x7f884010c2d0 2026-02-13T02:43:01.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.862+0000 7f883f7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f884010c2d0 0x7f8840121d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f884010c2d0 0x7f8840121d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:42590/0 (socket says 10.20.193.78:42590) 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 -- 10.20.193.78:0/1772526668 learned_addr learned my addr 10.20.193.78:0/1772526668 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883ffff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010b8e0 0x7f88401217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f8844ffe6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8840110ef0 0x7f88401270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 -- 10.20.193.78:0/1772526668 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010b8e0 msgr2=0x7f88401217f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010b8e0 0x7f88401217f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 -- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8840110ef0 msgr2=0x7f88401270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8840110ef0 0x7f88401270f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 -- 10.20.193.78:0/1772526668 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c0094c0 con 0x7f884010c2d0 2026-02-13T02:43:01.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f8844ffe6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8840110ef0 0x7f88401270f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:43:01.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883f7fe6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f884010c2d0 0x7f8840121d30 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8830009490 tx=0x7f883000bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:01.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883d7fa6c0 1 -- 10.20.193.78:0/1772526668 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8830004a80 con 0x7f884010c2d0 2026-02-13T02:43:01.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883d7fa6c0 1 -- 10.20.193.78:0/1772526668 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8830009030 con 0x7f884010c2d0 2026-02-13T02:43:01.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f883d7fa6c0 1 -- 10.20.193.78:0/1772526668 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f883000ce50 con 0x7f884010c2d0 2026-02-13T02:43:01.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883400a660 con 0x7f884010c2d0 2026-02-13T02:43:01.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.863+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8840168280 con 0x7f884010c2d0 2026-02-13T02:43:01.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.864+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884005fb90 con 0x7f884010c2d0 2026-02-13T02:43:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.866+0000 7f883d7fa6c0 1 -- 10.20.193.78:0/1772526668 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8830004ce0 con 0x7f884010c2d0 2026-02-13T02:43:01.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.867+0000 7f883d7fa6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f88140b5830 0x7f88140d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.868+0000 7f883d7fa6c0 1 -- 10.20.193.78:0/1772526668 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f88300e3cd0 con 0x7f884010c2d0 2026-02-13T02:43:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.868+0000 7f883d7fa6c0 1 -- 10.20.193.78:0/1772526668 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88300e4150 con 0x7f884010c2d0 2026-02-13T02:43:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.868+0000 7f883ffff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f88140b5830 0x7f88140d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:01.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.868+0000 7f883ffff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f88140b5830 0x7f88140d5ce0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f882c004750 tx=0x7f882c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:01.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.992+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f884010bcb0 con 0x7f884010c2d0 2026-02-13T02:43:01.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.992+0000 7f883d7fa6c0 1 -- 10.20.193.78:0/1772526668 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f88300a64f0 con 0x7f884010c2d0 2026-02-13T02:43:01.994 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:01.994 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:01.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f88140b5830 msgr2=0x7f88140d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:01.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f88140b5830 0x7f88140d5ce0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f882c004750 tx=0x7f882c009260 comp rx=0 tx=0).stop 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f884010c2d0 msgr2=0x7f8840121d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f884010c2d0 0x7f8840121d30 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8830009490 tx=0x7f883000bc50 comp rx=0 tx=0).stop 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 shutdown_connections 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f88140b5830 0x7f88140d5ce0 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8840110ef0 0x7f88401270f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f884010c2d0 0x7f8840121d30 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 --2- 10.20.193.78:0/1772526668 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010b8e0 0x7f88401217f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 >> 10.20.193.78:0/1772526668 conn(0x7f88400e9570 msgr2=0x7f8840109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:01.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 shutdown_connections 2026-02-13T02:43:01.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:01.993+0000 7f88457ff6c0 1 -- 10.20.193.78:0/1772526668 wait complete. 2026-02-13T02:43:02.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:02 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1772526668' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:02.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:02 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1772526668' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:02.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:02 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1772526668' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:03.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:03 trial091 ceph-mon[27614]: pgmap v217: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 12 op/s 2026-02-13T02:43:03.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:03 trial078 ceph-mon[22944]: pgmap v217: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 12 op/s 2026-02-13T02:43:03.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:03 trial154 ceph-mon[27921]: pgmap v217: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 12 op/s 2026-02-13T02:43:05.098 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:05.283 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.470+0000 7f714a7d56c0 1 -- 10.20.193.78:0/4270015692 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f71441149c0 msgr2=0x7f7144114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.470+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/4270015692 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f71441149c0 0x7f7144114ee0 secure :-1 s=READY pgs=140 gs=3 cs=0 l=1 c_cookie=4611276921738625469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7138006fd0 tx=0x7f713802fd30 comp rx=0 tx=0).stop 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 -- 10.20.193.78:0/4270015692 shutdown_connections 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/4270015692 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f71441149c0 0x7f7144114ee0 unknown :-1 s=CLOSED pgs=140 gs=3 cs=0 l=1 c_cookie=4611276921738625469 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/4270015692 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 0x7f7144114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/4270015692 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f714411b510 0x7f714411b8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 -- 10.20.193.78:0/4270015692 >> 10.20.193.78:0/4270015692 conn(0x7f7144058a50 msgr2=0x7f7144058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 -- 10.20.193.78:0/4270015692 shutdown_connections 2026-02-13T02:43:05.472 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 -- 10.20.193.78:0/4270015692 wait complete. 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 Processor -- start 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.471+0000 7f714a7d56c0 1 -- start start 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f714a7d56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 0x7f714412b770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f714a7d56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f71441149c0 0x7f714412bcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f714a7d56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f714411b510 0x7f7144131070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f714a7d56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f71441316c0 con 0x7f7144113dc0 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f714a7d56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7144131830 con 0x7f714411b510 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f714a7d56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71441319f0 con 0x7f71441149c0 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 0x7f714412b770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 0x7f714412b770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:43948/0 (socket says 10.20.193.78:43948) 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 -- 10.20.193.78:0/1426452912 learned_addr learned my addr 10.20.193.78:0/1426452912 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f71437fe6c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f71441149c0 0x7f714412bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:05.473 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7148d476c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f714411b510 0x7f7144131070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 -- 10.20.193.78:0/1426452912 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f71441149c0 msgr2=0x7f714412bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f71441149c0 0x7f714412bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 -- 10.20.193.78:0/1426452912 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f714411b510 msgr2=0x7f7144131070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f714411b510 0x7f7144131070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 -- 10.20.193.78:0/1426452912 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7134009590 con 0x7f7144113dc0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7148d476c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f714411b510 0x7f7144131070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f7143fff6c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 0x7f714412b770 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7130005dc0 tx=0x7f713000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.472+0000 7f71417fa6c0 1 -- 10.20.193.78:0/1426452912 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7130004250 con 0x7f7144113dc0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.473+0000 7f71417fa6c0 1 -- 10.20.193.78:0/1426452912 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7130009070 con 0x7f7144113dc0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.473+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713800a5b0 con 0x7f7144113dc0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.473+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7144172200 con 0x7f7144113dc0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.473+0000 7f71417fa6c0 1 -- 10.20.193.78:0/1426452912 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f713000cde0 con 0x7f7144113dc0 2026-02-13T02:43:05.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.473+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714405b000 con 0x7f7144113dc0 2026-02-13T02:43:05.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.475+0000 7f71417fa6c0 1 -- 10.20.193.78:0/1426452912 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f71300028c0 con 0x7f7144113dc0 2026-02-13T02:43:05.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.477+0000 7f71417fa6c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71180b57e0 0x7f71180d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:05.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.477+0000 7f71417fa6c0 1 -- 10.20.193.78:0/1426452912 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f71300e3c90 con 0x7f7144113dc0 2026-02-13T02:43:05.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.477+0000 7f71437fe6c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71180b57e0 0x7f71180d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:05.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.477+0000 7f71417fa6c0 1 -- 10.20.193.78:0/1426452912 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f71300e4090 con 0x7f7144113dc0 2026-02-13T02:43:05.480 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.478+0000 7f71437fe6c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71180b57e0 0x7f71180d5c90 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7144132100 tx=0x7f7134009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:05.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.600+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7144114ee0 con 0x7f7144113dc0 2026-02-13T02:43:05.602 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.600+0000 7f71417fa6c0 1 -- 10.20.193.78:0/1426452912 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f71300a64b0 con 0x7f7144113dc0 2026-02-13T02:43:05.603 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:05.603 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:05.603 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71180b57e0 msgr2=0x7f71180d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71180b57e0 0x7f71180d5c90 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7144132100 tx=0x7f7134009310 comp rx=0 tx=0).stop 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 msgr2=0x7f714412b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 0x7f714412b770 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7130005dc0 tx=0x7f713000bbb0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 shutdown_connections 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f71180b57e0 0x7f71180d5c90 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f714411b510 0x7f7144131070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f71441149c0 0x7f714412bcb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.604 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 --2- 10.20.193.78:0/1426452912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7144113dc0 0x7f714412b770 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:05.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 >> 10.20.193.78:0/1426452912 conn(0x7f7144058a50 msgr2=0x7f71440599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:05.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 shutdown_connections 2026-02-13T02:43:05.605 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:05.602+0000 7f714a7d56c0 1 -- 10.20.193.78:0/1426452912 wait complete. 2026-02-13T02:43:05.665 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:05 trial078 ceph-mon[22944]: pgmap v218: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:05.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:05 trial091 ceph-mon[27614]: pgmap v218: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:05.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:05 trial154 ceph-mon[27921]: pgmap v218: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:06.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:06 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1426452912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:06.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:06 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1426452912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:06.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:06 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1426452912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:07.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:07 trial091 ceph-mon[27614]: pgmap v219: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:07.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:07 trial078 ceph-mon[22944]: pgmap v219: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:07.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:07 trial154 ceph-mon[27921]: pgmap v219: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:08.711 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:08.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:08 trial078 ceph-mon[22944]: mgrmap e17: x(active, since 3m), standbys: y, z 2026-02-13T02:43:08.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:08 trial154 ceph-mon[27921]: mgrmap e17: x(active, since 3m), standbys: y, z 2026-02-13T02:43:08.901 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:08.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:08 trial091 ceph-mon[27614]: mgrmap e17: x(active, since 3m), standbys: y, z 2026-02-13T02:43:09.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 -- 10.20.193.78:0/2158343134 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 msgr2=0x7ff75c10bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:09.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 --2- 10.20.193.78:0/2158343134 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c10bcb0 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=13304025240604720451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff750009970 tx=0x7ff75002ed20 comp rx=0 tx=0).stop 2026-02-13T02:43:09.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 -- 10.20.193.78:0/2158343134 shutdown_connections 2026-02-13T02:43:09.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 --2- 10.20.193.78:0/2158343134 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff75c110ef0 0x7ff75c111370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 --2- 10.20.193.78:0/2158343134 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff75c10c2d0 0x7ff75c1108a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.091 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 --2- 10.20.193.78:0/2158343134 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c10bcb0 unknown :-1 s=CLOSED pgs=141 gs=2 cs=0 l=1 c_cookie=13304025240604720451 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 -- 10.20.193.78:0/2158343134 >> 10.20.193.78:0/2158343134 conn(0x7ff75c0e9570 msgr2=0x7ff75c109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:09.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 -- 10.20.193.78:0/2158343134 shutdown_connections 2026-02-13T02:43:09.092 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.089+0000 7ff75bfff6c0 1 -- 10.20.193.78:0/2158343134 wait complete. 2026-02-13T02:43:09.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 Processor -- start 2026-02-13T02:43:09.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 -- start start 2026-02-13T02:43:09.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c121780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:09.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff75c10c2d0 0x7ff75c121cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:09.093 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff75c110ef0 0x7ff75c127080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c1276d0 con 0x7ff75c110ef0 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c127840 con 0x7ff75c10b8e0 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.090+0000 7ff75bfff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c127a00 con 0x7ff75c10c2d0 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c121780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c121780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:43076/0 (socket says 10.20.193.78:43076) 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 -- 10.20.193.78:0/3569755916 learned_addr learned my addr 10.20.193.78:0/3569755916 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75b7fe6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff75c110ef0 0x7ff75c127080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 -- 10.20.193.78:0/3569755916 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff75c10c2d0 msgr2=0x7ff75c121cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff75c10c2d0 0x7ff75c121cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 -- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff75c110ef0 msgr2=0x7ff75c127080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:09.094 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff75c110ef0 0x7ff75c127080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 -- 10.20.193.78:0/3569755916 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff750009590 con 0x7ff75c10b8e0 2026-02-13T02:43:09.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75affd6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c121780 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7500098c0 tx=0x7ff75002fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:09.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff7608c66c0 1 -- 10.20.193.78:0/3569755916 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff750002ae0 con 0x7ff75c10b8e0 2026-02-13T02:43:09.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff7608c66c0 1 -- 10.20.193.78:0/3569755916 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff750002c40 con 0x7ff75c10b8e0 2026-02-13T02:43:09.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75bfff6c0 1 -- 10.20.193.78:0/3569755916 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75c127ce0 con 0x7ff75c10b8e0 2026-02-13T02:43:09.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff7608c66c0 1 -- 10.20.193.78:0/3569755916 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7500312b0 con 0x7ff75c10b8e0 2026-02-13T02:43:09.095 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.091+0000 7ff75bfff6c0 1 -- 10.20.193.78:0/3569755916 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75c1683c0 con 0x7ff75c10b8e0 2026-02-13T02:43:09.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.092+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff75c05fb90 con 0x7ff75c10b8e0 2026-02-13T02:43:09.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.094+0000 7ff7608c66c0 1 -- 10.20.193.78:0/3569755916 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff7500071c0 con 0x7ff75c10b8e0 2026-02-13T02:43:09.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.095+0000 7ff7608c66c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7300b5650 0x7ff7300d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:09.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.095+0000 7ff7608c66c0 1 -- 10.20.193.78:0/3569755916 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7ff750107e80 con 0x7ff75c10b8e0 2026-02-13T02:43:09.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.096+0000 7ff7608c66c0 1 -- 10.20.193.78:0/3569755916 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff750108300 con 0x7ff75c10b8e0 2026-02-13T02:43:09.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.096+0000 7ff75a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7300b5650 0x7ff7300d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:09.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.096+0000 7ff75a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7300b5650 0x7ff7300d5b00 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff75c128110 tx=0x7ff7440096a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:09.221 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.220+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff75c10bcb0 con 0x7ff75c10b8e0 2026-02-13T02:43:09.222 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.220+0000 7ff7608c66c0 1 -- 10.20.193.78:0/3569755916 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff7500ca800 con 0x7ff75c10b8e0 2026-02-13T02:43:09.222 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:09.222 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:09.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7300b5650 msgr2=0x7ff7300d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:09.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7300b5650 0x7ff7300d5b00 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff75c128110 tx=0x7ff7440096a0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 msgr2=0x7ff75c121780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:09.223 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c121780 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7500098c0 tx=0x7ff75002fb20 comp rx=0 tx=0).stop 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 shutdown_connections 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff7300b5650 0x7ff7300d5b00 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff75c110ef0 0x7ff75c127080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff75c10c2d0 0x7ff75c121cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 --2- 10.20.193.78:0/3569755916 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff75c10b8e0 0x7ff75c121780 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.221+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 >> 10.20.193.78:0/3569755916 conn(0x7ff75c0e9570 msgr2=0x7ff75c109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.222+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 shutdown_connections 2026-02-13T02:43:09.224 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:09.222+0000 7ff73a7fc6c0 1 -- 10.20.193.78:0/3569755916 wait complete. 2026-02-13T02:43:09.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:09 trial078 ceph-mon[22944]: pgmap v220: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2026-02-13T02:43:09.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:09 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3569755916' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:09.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:09 trial154 ceph-mon[27921]: pgmap v220: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2026-02-13T02:43:09.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:09 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3569755916' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:09.846 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:09 trial091 ceph-mon[27614]: pgmap v220: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 682 B/s wr, 12 op/s 2026-02-13T02:43:09.846 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:09 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3569755916' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:11.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:11 trial078 ceph-mon[22944]: pgmap v221: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:11.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:11 trial154 ceph-mon[27921]: pgmap v221: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:11.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:11 trial091 ceph-mon[27614]: pgmap v221: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:12.328 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:12.515 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:12.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 -- 10.20.193.78:0/4025894628 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10dd20 msgr2=0x7f920c10e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:12.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 --2- 10.20.193.78:0/4025894628 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10dd20 0x7f920c10e0f0 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=6510870712840836918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91fc009970 tx=0x7f91fc02ed50 comp rx=0 tx=0).stop 2026-02-13T02:43:12.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 -- 10.20.193.78:0/4025894628 shutdown_connections 2026-02-13T02:43:12.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 --2- 10.20.193.78:0/4025894628 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f920c1532d0 0x7f920c173710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 --2- 10.20.193.78:0/4025894628 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f920c10e710 0x7f920c152d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 --2- 10.20.193.78:0/4025894628 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10dd20 0x7f920c10e0f0 unknown :-1 s=CLOSED pgs=119 gs=2 cs=0 l=1 c_cookie=6510870712840836918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 -- 10.20.193.78:0/4025894628 >> 10.20.193.78:0/4025894628 conn(0x7f920c0e9700 msgr2=0x7f920c109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:12.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 -- 10.20.193.78:0/4025894628 shutdown_connections 2026-02-13T02:43:12.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.721+0000 7f9212cb36c0 1 -- 10.20.193.78:0/4025894628 wait complete. 2026-02-13T02:43:12.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 Processor -- start 2026-02-13T02:43:12.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 -- start start 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f920c10dd20 0x7f920c161340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10e710 0x7f920c161880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f920c1532d0 0x7f920c166c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f920c167290 con 0x7f920c10dd20 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f920c167400 con 0x7f920c1532d0 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.722+0000 7f9212cb36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f920c1675c0 con 0x7f920c10e710 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f92112256c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f920c1532d0 0x7f920c166c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9203fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10e710 0x7f920c161880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f92112256c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f920c1532d0 0x7f920c166c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:43088/0 (socket says 10.20.193.78:43088) 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f92112256c0 1 -- 10.20.193.78:0/432792897 learned_addr learned my addr 10.20.193.78:0/432792897 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:12.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9210a246c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f920c10dd20 0x7f920c161340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9203fff6c0 1 -- 10.20.193.78:0/432792897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f920c1532d0 msgr2=0x7f920c166c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9203fff6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f920c1532d0 0x7f920c166c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9203fff6c0 1 -- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f920c10dd20 msgr2=0x7f920c161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9203fff6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f920c10dd20 0x7f920c161340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9203fff6c0 1 -- 10.20.193.78:0/432792897 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc009590 con 0x7f920c10e710 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9203fff6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10e710 0x7f920c161880 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f400b6c0 tx=0x7f91f400bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9201ffb6c0 1 -- 10.20.193.78:0/432792897 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f4004240 con 0x7f920c10e710 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9201ffb6c0 1 -- 10.20.193.78:0/432792897 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91f4009030 con 0x7f920c10e710 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9212cb36c0 1 -- 10.20.193.78:0/432792897 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c1678a0 con 0x7f920c10e710 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9201ffb6c0 1 -- 10.20.193.78:0/432792897 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91f40036e0 con 0x7f920c10e710 2026-02-13T02:43:12.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.723+0000 7f9212cb36c0 1 -- 10.20.193.78:0/432792897 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c14ee70 con 0x7f920c10e710 2026-02-13T02:43:12.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.724+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c167ac0 con 0x7f920c10e710 2026-02-13T02:43:12.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.726+0000 7f9201ffb6c0 1 -- 10.20.193.78:0/432792897 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f91f4003880 con 0x7f920c10e710 2026-02-13T02:43:12.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.728+0000 7f9201ffb6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f91e80b5650 0x7f91e80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:12.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.728+0000 7f9201ffb6c0 1 -- 10.20.193.78:0/432792897 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f91f40e3a90 con 0x7f920c10e710 2026-02-13T02:43:12.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.728+0000 7f9201ffb6c0 1 -- 10.20.193.78:0/432792897 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f91f411c5e0 con 0x7f920c10e710 2026-02-13T02:43:12.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.728+0000 7f9210a246c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f91e80b5650 0x7f91e80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:12.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.729+0000 7f9210a246c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f91e80b5650 0x7f91e80d5b00 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91fc0023e0 tx=0x7f91fc005c00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:12.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.852+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f920c162490 con 0x7f920c10e710 2026-02-13T02:43:12.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.852+0000 7f9201ffb6c0 1 -- 10.20.193.78:0/432792897 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f91f40a6410 con 0x7f920c10e710 2026-02-13T02:43:12.854 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:12.854 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:12.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f91e80b5650 msgr2=0x7f91e80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:12.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f91e80b5650 0x7f91e80d5b00 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91fc0023e0 tx=0x7f91fc005c00 comp rx=0 tx=0).stop 2026-02-13T02:43:12.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10e710 msgr2=0x7f920c161880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:12.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10e710 0x7f920c161880 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91f400b6c0 tx=0x7f91f400bb90 comp rx=0 tx=0).stop 2026-02-13T02:43:12.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 shutdown_connections 2026-02-13T02:43:12.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f91e80b5650 0x7f91e80d5b00 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f920c1532d0 0x7f920c166c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f920c10e710 0x7f920c161880 unknown :-1 s=CLOSED pgs=120 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 --2- 10.20.193.78:0/432792897 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f920c10dd20 0x7f920c161340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:12.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 >> 10.20.193.78:0/432792897 conn(0x7f920c0e9700 msgr2=0x7f920c109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:12.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 shutdown_connections 2026-02-13T02:43:12.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:12.853+0000 7f91db7fe6c0 1 -- 10.20.193.78:0/432792897 wait complete. 2026-02-13T02:43:13.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:13 trial078 ceph-mon[22944]: pgmap v222: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T02:43:13.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:13 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/432792897' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:13.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:13 trial154 ceph-mon[27921]: pgmap v222: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T02:43:13.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:13 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/432792897' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:13.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:13 trial091 ceph-mon[27614]: pgmap v222: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T02:43:13.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:13 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/432792897' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:15.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:15 trial078 ceph-mon[22944]: pgmap v223: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:15.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:15 trial154 ceph-mon[27921]: pgmap v223: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:15.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:15 trial091 ceph-mon[27614]: pgmap v223: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:15.960 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:16.146 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:16.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 -- 10.20.193.78:0/1716956874 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c10f200 msgr2=0x7fc47c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:16.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 --2- 10.20.193.78:0/1716956874 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c10f200 0x7fc47c10f5d0 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=7917792569317195228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740099a0 tx=0x7fc47402ed20 comp rx=0 tx=0).stop 2026-02-13T02:43:16.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 -- 10.20.193.78:0/1716956874 shutdown_connections 2026-02-13T02:43:16.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 --2- 10.20.193.78:0/1716956874 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c115410 0x7fc47c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 --2- 10.20.193.78:0/1716956874 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc47c10fbf0 0x7fc47c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 --2- 10.20.193.78:0/1716956874 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c10f200 0x7fc47c10f5d0 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=7917792569317195228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 -- 10.20.193.78:0/1716956874 >> 10.20.193.78:0/1716956874 conn(0x7fc47c0ecb00 msgr2=0x7fc47c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:16.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.340+0000 7fc48497b6c0 1 -- 10.20.193.78:0/1716956874 shutdown_connections 2026-02-13T02:43:16.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.341+0000 7fc48497b6c0 1 -- 10.20.193.78:0/1716956874 wait complete. 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.341+0000 7fc48497b6c0 1 Processor -- start 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.341+0000 7fc48497b6c0 1 -- start start 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc48497b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c10f200 0x7fc47c11d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc48497b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc47c115410 0x7fc47c11d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc48497b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c122ac0 0x7fc47c122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc48497b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c1234d0 con 0x7fc47c122ac0 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc48497b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c123640 con 0x7fc47c10f200 2026-02-13T02:43:16.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc48497b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c123800 con 0x7fc47c115410 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c10f200 0x7fc47c11d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c10f200 0x7fc47c11d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:46984/0 (socket says 10.20.193.78:46984) 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 -- 10.20.193.78:0/1421824292 learned_addr learned my addr 10.20.193.78:0/1421824292 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc481eeb6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc47c115410 0x7fc47c11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc482eed6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c122ac0 0x7fc47c122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 -- 10.20.193.78:0/1421824292 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc47c115410 msgr2=0x7fc47c11d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc47c115410 0x7fc47c11d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 -- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c122ac0 msgr2=0x7fc47c122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c122ac0 0x7fc47c122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 -- 10.20.193.78:0/1421824292 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc474009590 con 0x7fc47c10f200 2026-02-13T02:43:16.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.342+0000 7fc4826ec6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c10f200 0x7fc47c11d1c0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc474031fd0 tx=0x7fc47402fc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:16.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.343+0000 7fc4677fe6c0 1 -- 10.20.193.78:0/1421824292 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc474002ae0 con 0x7fc47c10f200 2026-02-13T02:43:16.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.343+0000 7fc4677fe6c0 1 -- 10.20.193.78:0/1421824292 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc4740046b0 con 0x7fc47c10f200 2026-02-13T02:43:16.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.343+0000 7fc48497b6c0 1 -- 10.20.193.78:0/1421824292 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c163c50 con 0x7fc47c10f200 2026-02-13T02:43:16.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.343+0000 7fc4677fe6c0 1 -- 10.20.193.78:0/1421824292 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4740372f0 con 0x7fc47c10f200 2026-02-13T02:43:16.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.343+0000 7fc48497b6c0 1 -- 10.20.193.78:0/1421824292 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c164080 con 0x7fc47c10f200 2026-02-13T02:43:16.347 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.343+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47c1104d0 con 0x7fc47c10f200 2026-02-13T02:43:16.348 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.346+0000 7fc4677fe6c0 1 -- 10.20.193.78:0/1421824292 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fc474002c40 con 0x7fc47c10f200 2026-02-13T02:43:16.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.347+0000 7fc4677fe6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc4580b56d0 0x7fc4580d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:16.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.347+0000 7fc4677fe6c0 1 -- 10.20.193.78:0/1421824292 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7fc474107d80 con 0x7fc47c10f200 2026-02-13T02:43:16.349 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.348+0000 7fc4677fe6c0 1 -- 10.20.193.78:0/1421824292 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc474108180 con 0x7fc47c10f200 2026-02-13T02:43:16.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.348+0000 7fc481eeb6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc4580b56d0 0x7fc4580d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:16.350 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.348+0000 7fc481eeb6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc4580b56d0 0x7fc4580d5b80 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc468005980 tx=0x7fc468005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:16.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.472+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc47c10f5d0 con 0x7fc47c10f200 2026-02-13T02:43:16.474 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.472+0000 7fc4677fe6c0 1 -- 10.20.193.78:0/1421824292 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc4740ca700 con 0x7fc47c10f200 2026-02-13T02:43:16.474 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:16.474 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:16.475 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.473+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc4580b56d0 msgr2=0x7fc4580d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.473+0000 7fc4657fa6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc4580b56d0 0x7fc4580d5b80 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc468005980 tx=0x7fc468005910 comp rx=0 tx=0).stop 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.473+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c10f200 msgr2=0x7fc47c11d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.473+0000 7fc4657fa6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c10f200 0x7fc47c11d1c0 secure :-1 s=READY pgs=143 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc474031fd0 tx=0x7fc47402fc80 comp rx=0 tx=0).stop 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.473+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 shutdown_connections 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.474+0000 7fc4657fa6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fc4580b56d0 0x7fc4580d5b80 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.474+0000 7fc4657fa6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc47c122ac0 0x7fc47c122f60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.474+0000 7fc4657fa6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc47c115410 0x7fc47c11d700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.474+0000 7fc4657fa6c0 1 --2- 10.20.193.78:0/1421824292 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc47c10f200 0x7fc47c11d1c0 unknown :-1 s=CLOSED pgs=143 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.474+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 >> 10.20.193.78:0/1421824292 conn(0x7fc47c0ecb00 msgr2=0x7fc47c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:16.476 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.474+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 shutdown_connections 2026-02-13T02:43:16.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:16.474+0000 7fc4657fa6c0 1 -- 10.20.193.78:0/1421824292 wait complete. 2026-02-13T02:43:17.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:17 trial078 ceph-mon[22944]: pgmap v224: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:17.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:17 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1421824292' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:17.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:17 trial154 ceph-mon[27921]: pgmap v224: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:17.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:17 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1421824292' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:17.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:17 trial091 ceph-mon[27614]: pgmap v224: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T02:43:17.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:17 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1421824292' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:19.614 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:19.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:19 trial078 ceph-mon[22944]: pgmap v225: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T02:43:19.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:19 trial154 ceph-mon[27921]: pgmap v225: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T02:43:19.800 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:19.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:19 trial091 ceph-mon[27614]: pgmap v225: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.988+0000 7f62663936c0 1 -- 10.20.193.78:0/344142124 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f626010fa50 msgr2=0x7f6260114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.988+0000 7f62663936c0 1 --2- 10.20.193.78:0/344142124 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f626010fa50 0x7f6260114a90 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=5614943144596394768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62540099a0 tx=0x7f625402ed00 comp rx=0 tx=0).stop 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 -- 10.20.193.78:0/344142124 shutdown_connections 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 --2- 10.20.193.78:0/344142124 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6260115270 0x7f6260175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 --2- 10.20.193.78:0/344142124 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f626010fa50 0x7f6260114a90 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=5614943144596394768 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 --2- 10.20.193.78:0/344142124 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f626010f060 0x7f626010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 -- 10.20.193.78:0/344142124 >> 10.20.193.78:0/344142124 conn(0x7f62600ec980 msgr2=0x7f626010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 -- 10.20.193.78:0/344142124 shutdown_connections 2026-02-13T02:43:19.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 -- 10.20.193.78:0/344142124 wait complete. 2026-02-13T02:43:19.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 Processor -- start 2026-02-13T02:43:19.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.989+0000 7f62663936c0 1 -- start start 2026-02-13T02:43:19.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f62663936c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f626010f060 0x7f62600f4a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:19.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f62663936c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6260115270 0x7f6260175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f6264b906c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6260115270 0x7f6260175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f6264b906c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6260115270 0x7f6260175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:41178/0 (socket says 10.20.193.78:41178) 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f62663936c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62600f50a0 0x7f62600fa370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f62663936c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f62600f5790 con 0x7f6260115270 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f62663936c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f62600fa8b0 con 0x7f626010f060 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f62663936c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62600faa70 con 0x7f62600f50a0 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.990+0000 7f6264b906c0 1 -- 10.20.193.78:0/3667636797 learned_addr learned my addr 10.20.193.78:0/3667636797 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6265b926c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62600f50a0 0x7f62600fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f62653916c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f626010f060 0x7f62600f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:19.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6264b906c0 1 -- 10.20.193.78:0/3667636797 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62600f50a0 msgr2=0x7f62600fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6264b906c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62600f50a0 0x7f62600fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6264b906c0 1 -- 10.20.193.78:0/3667636797 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f626010f060 msgr2=0x7f62600f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6264b906c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f626010f060 0x7f62600f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6264b906c0 1 -- 10.20.193.78:0/3667636797 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6254009590 con 0x7f6260115270 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f62653916c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f626010f060 0x7f62600f4a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6265b926c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62600f50a0 0x7f62600fa370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f6264b906c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6260115270 0x7f6260175b10 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f625402f210 tx=0x7f625402fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f624e7fc6c0 1 -- 10.20.193.78:0/3667636797 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6254002ae0 con 0x7f6260115270 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f624e7fc6c0 1 -- 10.20.193.78:0/3667636797 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f62540046b0 con 0x7f6260115270 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62600facf0 con 0x7f6260115270 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f624e7fc6c0 1 -- 10.20.193.78:0/3667636797 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6254037520 con 0x7f6260115270 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.991+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62600fb1c0 con 0x7f6260115270 2026-02-13T02:43:19.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.992+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6260110330 con 0x7f6260115270 2026-02-13T02:43:19.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.994+0000 7f624e7fc6c0 1 -- 10.20.193.78:0/3667636797 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6254002c80 con 0x7f6260115270 2026-02-13T02:43:19.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.995+0000 7f624e7fc6c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f623c0b56d0 0x7f623c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:19.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.996+0000 7f624e7fc6c0 1 -- 10.20.193.78:0/3667636797 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f6254107c80 con 0x7f6260115270 2026-02-13T02:43:19.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.996+0000 7f62653916c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f623c0b56d0 0x7f623c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:19.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.996+0000 7f624e7fc6c0 1 -- 10.20.193.78:0/3667636797 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6254108100 con 0x7f6260115270 2026-02-13T02:43:19.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:19.996+0000 7f62653916c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f623c0b56d0 0x7f623c0d5b80 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6250004750 tx=0x7f6250009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:20.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.121+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62600f5bc0 con 0x7f6260115270 2026-02-13T02:43:20.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.122+0000 7f624e7fc6c0 1 -- 10.20.193.78:0/3667636797 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f62540ca600 con 0x7f6260115270 2026-02-13T02:43:20.124 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:20.124 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:20.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f623c0b56d0 msgr2=0x7f623c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:20.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f623c0b56d0 0x7f623c0d5b80 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6250004750 tx=0x7f6250009260 comp rx=0 tx=0).stop 2026-02-13T02:43:20.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6260115270 msgr2=0x7f6260175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:20.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6260115270 0x7f6260175b10 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f625402f210 tx=0x7f625402fc60 comp rx=0 tx=0).stop 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 shutdown_connections 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f623c0b56d0 0x7f623c0d5b80 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62600f50a0 0x7f62600fa370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6260115270 0x7f6260175b10 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 --2- 10.20.193.78:0/3667636797 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f626010f060 0x7f62600f4a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.123+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 >> 10.20.193.78:0/3667636797 conn(0x7f62600ec980 msgr2=0x7f6260113a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.124+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 shutdown_connections 2026-02-13T02:43:20.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:20.124+0000 7f62663936c0 1 -- 10.20.193.78:0/3667636797 wait complete. 2026-02-13T02:43:20.465 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:20 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3667636797' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:20.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:20 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3667636797' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:20.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:20 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3667636797' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:21.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:21 trial078 ceph-mon[22944]: pgmap v226: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-13T02:43:21.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:21 trial154 ceph-mon[27921]: pgmap v226: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-13T02:43:21.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:21 trial091 ceph-mon[27614]: pgmap v226: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-13T02:43:23.230 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:23.415 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:23.535 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:23 trial078 ceph-mon[22944]: pgmap v227: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 11 op/s 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/1966311061 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410fa50 msgr2=0x7f06a4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/1966311061 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410fa50 0x7f06a4114a90 secure :-1 s=READY pgs=121 gs=3 cs=0 l=1 c_cookie=16402006151566609774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06940099a0 tx=0x7f069402ed20 comp rx=0 tx=0).stop 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/1966311061 shutdown_connections 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/1966311061 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06a4115270 0x7f06a4175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/1966311061 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410fa50 0x7f06a4114a90 unknown :-1 s=CLOSED pgs=121 gs=3 cs=0 l=1 c_cookie=16402006151566609774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/1966311061 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06a410f060 0x7f06a410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/1966311061 >> 10.20.193.78:0/1966311061 conn(0x7f06a40ec980 msgr2=0x7f06a410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/1966311061 shutdown_connections 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.621+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/1966311061 wait complete. 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 Processor -- start 2026-02-13T02:43:23.623 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 -- start start 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410f060 0x7f06a40f4980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06a4115270 0x7f06a4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06a40f4fb0 0x7f06a40fa280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06a40f56a0 con 0x7f06a4115270 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f06a40fa7c0 con 0x7f06a40f4fb0 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a8a7f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06a40fa980 con 0x7f06a410f060 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a37fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410f060 0x7f06a40f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a37fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410f060 0x7f06a40f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:56126/0 (socket says 10.20.193.78:56126) 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a37fe6c0 1 -- 10.20.193.78:0/4066757878 learned_addr learned my addr 10.20.193.78:0/4066757878 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a3fff6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06a40f4fb0 0x7f06a40fa280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:23.624 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.622+0000 7f06a2ffd6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06a4115270 0x7f06a4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a3fff6c0 1 -- 10.20.193.78:0/4066757878 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410f060 msgr2=0x7f06a40f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a3fff6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410f060 0x7f06a40f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a3fff6c0 1 -- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06a4115270 msgr2=0x7f06a4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a3fff6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06a4115270 0x7f06a4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a3fff6c0 1 -- 10.20.193.78:0/4066757878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0694009590 con 0x7f06a40f4fb0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a3fff6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06a40f4fb0 0x7f06a40fa280 secure :-1 s=READY pgs=144 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f069800c760 tx=0x7f069800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a0ff96c0 1 -- 10.20.193.78:0/4066757878 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0698003c40 con 0x7f06a40f4fb0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a0ff96c0 1 -- 10.20.193.78:0/4066757878 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f069800a070 con 0x7f06a40f4fb0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a0ff96c0 1 -- 10.20.193.78:0/4066757878 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f069800ddb0 con 0x7f06a40f4fb0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a40fac60 con 0x7f06a40f4fb0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.623+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a40fb0f0 con 0x7f06a40f4fb0 2026-02-13T02:43:23.625 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.624+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a4110330 con 0x7f06a40f4fb0 2026-02-13T02:43:23.628 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.626+0000 7f06a0ff96c0 1 -- 10.20.193.78:0/4066757878 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0698005030 con 0x7f06a40f4fb0 2026-02-13T02:43:23.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.628+0000 7f06a0ff96c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06780b56d0 0x7f06780d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:23.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.628+0000 7f06a0ff96c0 1 -- 10.20.193.78:0/4066757878 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f06980e48c0 con 0x7f06a40f4fb0 2026-02-13T02:43:23.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.628+0000 7f06a0ff96c0 1 -- 10.20.193.78:0/4066757878 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f06980e4d40 con 0x7f06a40f4fb0 2026-02-13T02:43:23.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.628+0000 7f06a37fe6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06780b56d0 0x7f06780d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:23.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.629+0000 7f06a37fe6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06780b56d0 0x7f06780d5b80 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06900095c0 tx=0x7f0690009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:23.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.752+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f06a410f430 con 0x7f06a40f4fb0 2026-02-13T02:43:23.753 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.752+0000 7f06a0ff96c0 1 -- 10.20.193.78:0/4066757878 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f06980a7240 con 0x7f06a40f4fb0 2026-02-13T02:43:23.754 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:23.754 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06780b56d0 msgr2=0x7f06780d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06780b56d0 0x7f06780d5b80 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06900095c0 tx=0x7f0690009260 comp rx=0 tx=0).stop 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06a40f4fb0 msgr2=0x7f06a40fa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06a40f4fb0 0x7f06a40fa280 secure :-1 s=READY pgs=144 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f069800c760 tx=0x7f069800cc30 comp rx=0 tx=0).stop 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 shutdown_connections 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06780b56d0 0x7f06780d5b80 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06a40f4fb0 0x7f06a40fa280 unknown :-1 s=CLOSED pgs=144 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06a4115270 0x7f06a4175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 --2- 10.20.193.78:0/4066757878 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06a410f060 0x7f06a40f4980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 >> 10.20.193.78:0/4066757878 conn(0x7f06a40ec980 msgr2=0x7f06a410d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 shutdown_connections 2026-02-13T02:43:23.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:23.753+0000 7f06a8a7f6c0 1 -- 10.20.193.78:0/4066757878 wait complete. 2026-02-13T02:43:23.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:23 trial154 ceph-mon[27921]: pgmap v227: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 11 op/s 2026-02-13T02:43:23.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:23 trial091 ceph-mon[27614]: pgmap v227: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 11 op/s 2026-02-13T02:43:24.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:24 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4066757878' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:24.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:24 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4066757878' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:24.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:24 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4066757878' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:25.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:25 trial078 ceph-mon[22944]: pgmap v228: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:25.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:25 trial154 ceph-mon[27921]: pgmap v228: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:25.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:25 trial091 ceph-mon[27614]: pgmap v228: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:26.858 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:27.043 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:27.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 -- 10.20.193.78:0/1585284224 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 msgr2=0x7f4508061110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:27.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 --2- 10.20.193.78:0/1585284224 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f4508061110 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=16168043733969560492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44f0009970 tx=0x7f44f002ed20 comp rx=0 tx=0).stop 2026-02-13T02:43:27.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 -- 10.20.193.78:0/1585284224 shutdown_connections 2026-02-13T02:43:27.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 --2- 10.20.193.78:0/1585284224 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4508159ac0 0x7f4508179ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 --2- 10.20.193.78:0/1585284224 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f4508061110 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=16168043733969560492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 --2- 10.20.193.78:0/1585284224 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45080622d0 0x7f45080607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 -- 10.20.193.78:0/1585284224 >> 10.20.193.78:0/1585284224 conn(0x7f45080ea880 msgr2=0x7f450810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 -- 10.20.193.78:0/1585284224 shutdown_connections 2026-02-13T02:43:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.231+0000 7f450eea76c0 1 -- 10.20.193.78:0/1585284224 wait complete. 2026-02-13T02:43:27.234 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 Processor -- start 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 -- start start 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f45080f2290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45080622d0 0x7f45080f27d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4508159ac0 0x7f45080f7b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f45080f81e0 con 0x7f4508060ce0 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f45080f8350 con 0x7f4508159ac0 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450eea76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45080f8510 con 0x7f45080622d0 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f45080f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f45080f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:54224/0 (socket says 10.20.193.78:54224) 2026-02-13T02:43:27.236 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 -- 10.20.193.78:0/719434043 learned_addr learned my addr 10.20.193.78:0/719434043 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f44fffff6c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45080622d0 0x7f45080f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450d4196c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4508159ac0 0x7f45080f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 -- 10.20.193.78:0/719434043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45080622d0 msgr2=0x7f45080f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45080622d0 0x7f45080f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 -- 10.20.193.78:0/719434043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4508159ac0 msgr2=0x7f45080f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4508159ac0 0x7f45080f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.232+0000 7f450cc186c0 1 -- 10.20.193.78:0/719434043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f0009590 con 0x7f4508060ce0 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.233+0000 7f450cc186c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f45080f2290 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44f800b710 tx=0x7f44f800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.233+0000 7f44fdffb6c0 1 -- 10.20.193.78:0/719434043 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44f8004250 con 0x7f4508060ce0 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.233+0000 7f44fdffb6c0 1 -- 10.20.193.78:0/719434043 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f44f8002da0 con 0x7f4508060ce0 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.233+0000 7f44fdffb6c0 1 -- 10.20.193.78:0/719434043 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44f800ce40 con 0x7f4508060ce0 2026-02-13T02:43:27.237 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.233+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45080f87f0 con 0x7f4508060ce0 2026-02-13T02:43:27.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.233+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45080f8eb0 con 0x7f4508060ce0 2026-02-13T02:43:27.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.233+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45080f8a10 con 0x7f4508060ce0 2026-02-13T02:43:27.238 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.236+0000 7f44fdffb6c0 1 -- 10.20.193.78:0/719434043 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f44f800c410 con 0x7f4508060ce0 2026-02-13T02:43:27.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.238+0000 7f44fdffb6c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f44e40b56d0 0x7f44e40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:27.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.238+0000 7f44fdffb6c0 1 -- 10.20.193.78:0/719434043 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f44f80e3ba0 con 0x7f4508060ce0 2026-02-13T02:43:27.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.239+0000 7f44fffff6c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f44e40b56d0 0x7f44e40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:27.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.239+0000 7f44fdffb6c0 1 -- 10.20.193.78:0/719434043 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f44f811c600 con 0x7f4508060ce0 2026-02-13T02:43:27.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.239+0000 7f44fffff6c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f44e40b56d0 0x7f44e40d5b80 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45080f8c20 tx=0x7f44f00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:27.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.362+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f45080f33e0 con 0x7f4508060ce0 2026-02-13T02:43:27.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.362+0000 7f44fdffb6c0 1 -- 10.20.193.78:0/719434043 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f44f80a6520 con 0x7f4508060ce0 2026-02-13T02:43:27.364 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:27.364 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:27.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.363+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f44e40b56d0 msgr2=0x7f44e40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:27.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.363+0000 7f450eea76c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f44e40b56d0 0x7f44e40d5b80 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45080f8c20 tx=0x7f44f00023a0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.363+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 msgr2=0x7f45080f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:27.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.363+0000 7f450eea76c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f45080f2290 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44f800b710 tx=0x7f44f800bbe0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.365 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 shutdown_connections 2026-02-13T02:43:27.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f44e40b56d0 0x7f44e40d5b80 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4508159ac0 0x7f45080f7b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45080622d0 0x7f45080f27d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 --2- 10.20.193.78:0/719434043 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4508060ce0 0x7f45080f2290 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:27.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 >> 10.20.193.78:0/719434043 conn(0x7f45080ea880 msgr2=0x7f450810dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:27.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 shutdown_connections 2026-02-13T02:43:27.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:27.364+0000 7f450eea76c0 1 -- 10.20.193.78:0/719434043 wait complete. 2026-02-13T02:43:27.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:27 trial078 ceph-mon[22944]: pgmap v229: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:27.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:27 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/719434043' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:27.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:27 trial154 ceph-mon[27921]: pgmap v229: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:27.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:27 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/719434043' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:27.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:27 trial091 ceph-mon[27614]: pgmap v229: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:27.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:27 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/719434043' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:29.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:29 trial154 ceph-mon[27921]: pgmap v230: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 11 op/s 2026-02-13T02:43:29.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:29 trial091 ceph-mon[27614]: pgmap v230: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 11 op/s 2026-02-13T02:43:29.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:29 trial078 ceph-mon[22944]: pgmap v230: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 11 op/s 2026-02-13T02:43:30.472 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:30.658 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 -- 10.20.193.78:0/2991313402 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f614010f060 msgr2=0x7f614010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2991313402 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f614010f060 0x7f614010f430 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=16666877710690605662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61300099a0 tx=0x7f613002ed00 comp rx=0 tx=0).stop 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 -- 10.20.193.78:0/2991313402 shutdown_connections 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2991313402 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6140115270 0x7f6140175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2991313402 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f614010fa50 0x7f6140114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2991313402 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f614010f060 0x7f614010f430 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=16666877710690605662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 -- 10.20.193.78:0/2991313402 >> 10.20.193.78:0/2991313402 conn(0x7f61400ec980 msgr2=0x7f614010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:30.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 -- 10.20.193.78:0/2991313402 shutdown_connections 2026-02-13T02:43:30.854 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.850+0000 7f614832c6c0 1 -- 10.20.193.78:0/2991313402 wait complete. 2026-02-13T02:43:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.851+0000 7f614832c6c0 1 Processor -- start 2026-02-13T02:43:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.851+0000 7f614832c6c0 1 -- start start 2026-02-13T02:43:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614832c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f614010f060 0x7f614011d050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614832c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6140115270 0x7f614011d590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:30.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614832c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6140122950 0x7f6140122df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614832c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6140123360 con 0x7f6140115270 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614832c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f61401234d0 con 0x7f6140122950 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614832c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6140123690 con 0x7f614010f060 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6140115270 0x7f614011d590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6140115270 0x7f614011d590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:54232/0 (socket says 10.20.193.78:54232) 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 -- 10.20.193.78:0/2895833873 learned_addr learned my addr 10.20.193.78:0/2895833873 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614609d6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f614010f060 0x7f614011d050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614689e6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6140122950 0x7f6140122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 -- 10.20.193.78:0/2895833873 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f614010f060 msgr2=0x7f614011d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f614010f060 0x7f614011d050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 -- 10.20.193.78:0/2895833873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6140122950 msgr2=0x7f6140122df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6140122950 0x7f6140122df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 -- 10.20.193.78:0/2895833873 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6130009590 con 0x7f6140115270 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f614589c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6140115270 0x7f614011d590 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f613400b6c0 tx=0x7f613400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.852+0000 7f61277fe6c0 1 -- 10.20.193.78:0/2895833873 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6134004250 con 0x7f6140115270 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.853+0000 7f61277fe6c0 1 -- 10.20.193.78:0/2895833873 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6134009070 con 0x7f6140115270 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.853+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6140163b40 con 0x7f6140115270 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.853+0000 7f61277fe6c0 1 -- 10.20.193.78:0/2895833873 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f613400cd20 con 0x7f6140115270 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.853+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6140163fd0 con 0x7f6140115270 2026-02-13T02:43:30.857 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.853+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6140110330 con 0x7f6140115270 2026-02-13T02:43:30.858 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.855+0000 7f61277fe6c0 1 -- 10.20.193.78:0/2895833873 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f61340028c0 con 0x7f6140115270 2026-02-13T02:43:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.857+0000 7f61277fe6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f611c0b56d0 0x7f611c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.857+0000 7f61277fe6c0 1 -- 10.20.193.78:0/2895833873 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f61340e3bd0 con 0x7f6140115270 2026-02-13T02:43:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.857+0000 7f614609d6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f611c0b56d0 0x7f611c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:30.859 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.857+0000 7f61277fe6c0 1 -- 10.20.193.78:0/2895833873 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f613411c660 con 0x7f6140115270 2026-02-13T02:43:30.860 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.858+0000 7f614609d6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f611c0b56d0 0x7f611c0d5b80 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61300092e0 tx=0x7f6130005c00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:30.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.982+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f614010f430 con 0x7f6140115270 2026-02-13T02:43:30.984 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.982+0000 7f61277fe6c0 1 -- 10.20.193.78:0/2895833873 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f61340a6550 con 0x7f6140115270 2026-02-13T02:43:30.984 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:30.984 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:30.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f611c0b56d0 msgr2=0x7f611c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:30.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f611c0b56d0 0x7f611c0d5b80 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61300092e0 tx=0x7f6130005c00 comp rx=0 tx=0).stop 2026-02-13T02:43:30.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6140115270 msgr2=0x7f614011d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:30.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6140115270 0x7f614011d590 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f613400b6c0 tx=0x7f613400bb90 comp rx=0 tx=0).stop 2026-02-13T02:43:30.985 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 shutdown_connections 2026-02-13T02:43:30.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f611c0b56d0 0x7f611c0d5b80 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6140122950 0x7f6140122df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6140115270 0x7f614011d590 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 --2- 10.20.193.78:0/2895833873 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f614010f060 0x7f614011d050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:30.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 >> 10.20.193.78:0/2895833873 conn(0x7f61400ec980 msgr2=0x7f614010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:30.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 shutdown_connections 2026-02-13T02:43:30.986 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:30.983+0000 7f614832c6c0 1 -- 10.20.193.78:0/2895833873 wait complete. 2026-02-13T02:43:31.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:31 trial154 ceph-mon[27921]: pgmap v231: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:43:31.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:31 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2895833873' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:31 trial091 ceph-mon[27614]: pgmap v231: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:43:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:31 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2895833873' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:31.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:31 trial078 ceph-mon[22944]: pgmap v231: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:43:31.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:31 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2895833873' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:33.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:33 trial154 ceph-mon[27921]: pgmap v232: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 11 op/s 2026-02-13T02:43:33.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:33 trial091 ceph-mon[27614]: pgmap v232: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 11 op/s 2026-02-13T02:43:33.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:33 trial078 ceph-mon[22944]: pgmap v232: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 11 op/s 2026-02-13T02:43:34.093 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:34.279 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:34.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.475+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1006193494 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 msgr2=0x7f761c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:34.477 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.475+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1006193494 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c10f430 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=8254889293181014500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7610009970 tx=0x7f761002ed10 comp rx=0 tx=0).stop 2026-02-13T02:43:34.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.476+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1006193494 shutdown_connections 2026-02-13T02:43:34.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.476+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1006193494 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f761c115270 0x7f761c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.478 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.476+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1006193494 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f761c10fa50 0x7f761c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.476+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1006193494 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c10f430 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=8254889293181014500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.476+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1006193494 >> 10.20.193.78:0/1006193494 conn(0x7f761c0ec980 msgr2=0x7f761c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:34.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.476+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1006193494 shutdown_connections 2026-02-13T02:43:34.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.476+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1006193494 wait complete. 2026-02-13T02:43:34.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 Processor -- start 2026-02-13T02:43:34.479 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 -- start start 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c11d0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f761c115270 0x7f761c11d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f761c1229a0 0x7f761c122e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1233b0 con 0x7f761c1229a0 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f761c123520 con 0x7f761c10f060 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f76208fb6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f761c1236e0 con 0x7f761c115270 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f761ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c11d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f761a5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f761c115270 0x7f761c11d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f761b5776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f761c1229a0 0x7f761c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f761ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c11d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:58416/0 (socket says 10.20.193.78:58416) 2026-02-13T02:43:34.481 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.477+0000 7f761ad766c0 1 -- 10.20.193.78:0/1483447988 learned_addr learned my addr 10.20.193.78:0/1483447988 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f761ad766c0 1 -- 10.20.193.78:0/1483447988 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f761c115270 msgr2=0x7f761c11d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f761ad766c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f761c115270 0x7f761c11d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f761ad766c0 1 -- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f761c1229a0 msgr2=0x7f761c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f761ad766c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f761c1229a0 0x7f761c122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f761ad766c0 1 -- 10.20.193.78:0/1483447988 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7610009590 con 0x7f761c10f060 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f761ad766c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c11d0a0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76100092b0 tx=0x7f761002fca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f75fbfff6c0 1 -- 10.20.193.78:0/1483447988 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7610002ae0 con 0x7f761c10f060 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f75fbfff6c0 1 -- 10.20.193.78:0/1483447988 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7610002c40 con 0x7f761c10f060 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f75fbfff6c0 1 -- 10.20.193.78:0/1483447988 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76100372f0 con 0x7f761c10f060 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761c163b30 con 0x7f761c10f060 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.478+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761c163f60 con 0x7f761c10f060 2026-02-13T02:43:34.482 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.479+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761c110330 con 0x7f761c10f060 2026-02-13T02:43:34.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.481+0000 7f75fbfff6c0 1 -- 10.20.193.78:0/1483447988 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7610007260 con 0x7f761c10f060 2026-02-13T02:43:34.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.483+0000 7f75fbfff6c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f75f00b5650 0x7f75f00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:34.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.483+0000 7f75fbfff6c0 1 -- 10.20.193.78:0/1483447988 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8267+0+0 (secure 0 0 0) 0x7f7610107d70 con 0x7f761c10f060 2026-02-13T02:43:34.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.483+0000 7f761a5756c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f75f00b5650 0x7f75f00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:34.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.483+0000 7f75fbfff6c0 1 -- 10.20.193.78:0/1483447988 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f76101081f0 con 0x7f761c10f060 2026-02-13T02:43:34.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.484+0000 7f761a5756c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f75f00b5650 0x7f75f00d5b00 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f761c123a30 tx=0x7f7604009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:34.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.607+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f761c10f430 con 0x7f761c10f060 2026-02-13T02:43:34.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.608+0000 7f75fbfff6c0 1 -- 10.20.193.78:0/1483447988 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f76100ca6f0 con 0x7f761c10f060 2026-02-13T02:43:34.610 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:34.610 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:34.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f75f00b5650 msgr2=0x7f75f00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:34.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f75f00b5650 0x7f75f00d5b00 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f761c123a30 tx=0x7f7604009260 comp rx=0 tx=0).stop 2026-02-13T02:43:34.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 msgr2=0x7f761c11d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:34.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c11d0a0 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76100092b0 tx=0x7f761002fca0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 shutdown_connections 2026-02-13T02:43:34.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f75f00b5650 0x7f75f00d5b00 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f761c1229a0 0x7f761c122e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f761c115270 0x7f761c11d5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 --2- 10.20.193.78:0/1483447988 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f761c10f060 0x7f761c11d0a0 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:34.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 >> 10.20.193.78:0/1483447988 conn(0x7f761c0ec980 msgr2=0x7f761c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:34.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 shutdown_connections 2026-02-13T02:43:34.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:34.609+0000 7f76208fb6c0 1 -- 10.20.193.78:0/1483447988 wait complete. 2026-02-13T02:43:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:35 trial154 ceph-mon[27921]: pgmap v233: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:35.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:35 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1483447988' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:35.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:35 trial091 ceph-mon[27614]: pgmap v233: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:35.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:35 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1483447988' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:35 trial078 ceph-mon[22944]: pgmap v233: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:35 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1483447988' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-13T02:43:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T02:43:36.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:36 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11, 7, 6]} : dispatch 2026-02-13T02:43:36.878 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-13T02:43:36.878 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T02:43:36.878 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:36 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11, 7, 6]} : dispatch 2026-02-13T02:43:36.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-13T02:43:36.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2026-02-13T02:43:36.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:36 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11, 7, 6]} : dispatch 2026-02-13T02:43:37.748 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:37 trial154 ceph-mon[27921]: pgmap v234: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-13T02:43:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T02:43:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:37 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11, 7, 6]}]': finished 2026-02-13T02:43:37.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:37 trial154 ceph-mon[27921]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T02:43:37.798 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:37 trial078 ceph-mon[22944]: pgmap v234: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:37.798 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-13T02:43:37.798 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T02:43:37.798 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:37 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11, 7, 6]}]': finished 2026-02-13T02:43:37.798 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:37 trial078 ceph-mon[22944]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T02:43:37.933 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:37.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:37 trial091 ceph-mon[27614]: pgmap v234: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:43:37.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-13T02:43:37.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2026-02-13T02:43:37.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:37 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [5, 11, 7, 6]}]': finished 2026-02-13T02:43:37.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:37 trial091 ceph-mon[27614]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T02:43:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.134+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/1991855300 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 msgr2=0x7f1d6410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.134+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/1991855300 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 0x7f1d6410f430 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=212439837340702653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d540098d0 tx=0x7f1d5402ec40 comp rx=0 tx=0).stop 2026-02-13T02:43:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/1991855300 shutdown_connections 2026-02-13T02:43:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/1991855300 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 0x7f1d64175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/1991855300 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d6410fa50 0x7f1d64114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/1991855300 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 0x7f1d6410f430 unknown :-1 s=CLOSED pgs=122 gs=2 cs=0 l=1 c_cookie=212439837340702653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.136 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/1991855300 >> 10.20.193.78:0/1991855300 conn(0x7f1d640ec980 msgr2=0x7f1d6410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/1991855300 shutdown_connections 2026-02-13T02:43:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/1991855300 wait complete. 2026-02-13T02:43:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 Processor -- start 2026-02-13T02:43:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.135+0000 7f1d6a4876c0 1 -- start start 2026-02-13T02:43:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d6a4876c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 0x7f1d6411d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:38.137 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d6a4876c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 0x7f1d6411d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d6a4876c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d64122940 0x7f1d64122de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d6a4876c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64123350 con 0x7f1d64115270 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d6a4876c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1d641234c0 con 0x7f1d64122940 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d6a4876c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64123680 con 0x7f1d6410f060 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 0x7f1d6411d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 0x7f1d6411d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:59954/0 (socket says 10.20.193.78:59954) 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 -- 10.20.193.78:0/2529983073 learned_addr learned my addr 10.20.193.78:0/2529983073 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d694856c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 0x7f1d6411d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 -- 10.20.193.78:0/2529983073 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 msgr2=0x7f1d6411d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 0x7f1d6411d090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 -- 10.20.193.78:0/2529983073 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d64122940 msgr2=0x7f1d64122de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d64122940 0x7f1d64122de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 -- 10.20.193.78:0/2529983073 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d540094c0 con 0x7f1d64115270 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d68c846c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 0x7f1d6411d5d0 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d58005930 tx=0x7f1d5800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d527fc6c0 1 -- 10.20.193.78:0/2529983073 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d58004460 con 0x7f1d64115270 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.136+0000 7f1d527fc6c0 1 -- 10.20.193.78:0/2529983073 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1d580045c0 con 0x7f1d64115270 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.137+0000 7f1d527fc6c0 1 -- 10.20.193.78:0/2529983073 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d5800cdd0 con 0x7f1d64115270 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.137+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d64163b30 con 0x7f1d64115270 2026-02-13T02:43:38.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.137+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d64163fc0 con 0x7f1d64115270 2026-02-13T02:43:38.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.137+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d64110330 con 0x7f1d64115270 2026-02-13T02:43:38.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.140+0000 7f1d527fc6c0 1 -- 10.20.193.78:0/2529983073 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1d580026b0 con 0x7f1d64115270 2026-02-13T02:43:38.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.141+0000 7f1d527fc6c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1d400b5750 0x7f1d400d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:38.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.141+0000 7f1d527fc6c0 1 -- 10.20.193.78:0/2529983073 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f1d580e3c50 con 0x7f1d64115270 2026-02-13T02:43:38.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.142+0000 7f1d527fc6c0 1 -- 10.20.193.78:0/2529983073 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1d5811c660 con 0x7f1d64115270 2026-02-13T02:43:38.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.142+0000 7f1d694856c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1d400b5750 0x7f1d400d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:38.143 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.142+0000 7f1d694856c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1d400b5750 0x7f1d400d5c00 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d540097f0 tx=0x7f1d540023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:38.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.268+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1d6410f430 con 0x7f1d64115270 2026-02-13T02:43:38.269 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.268+0000 7f1d527fc6c0 1 -- 10.20.193.78:0/2529983073 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1d580a6570 con 0x7f1d64115270 2026-02-13T02:43:38.269 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:38.269 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1d400b5750 msgr2=0x7f1d400d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1d400b5750 0x7f1d400d5c00 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d540097f0 tx=0x7f1d540023a0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 msgr2=0x7f1d6411d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 0x7f1d6411d5d0 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d58005930 tx=0x7f1d5800bca0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 shutdown_connections 2026-02-13T02:43:38.270 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1d400b5750 0x7f1d400d5c00 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d64122940 0x7f1d64122de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1d64115270 0x7f1d6411d5d0 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 --2- 10.20.193.78:0/2529983073 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d6410f060 0x7f1d6411d090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 >> 10.20.193.78:0/2529983073 conn(0x7f1d640ec980 msgr2=0x7f1d6410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 shutdown_connections 2026-02-13T02:43:38.271 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:38.269+0000 7f1d6a4876c0 1 -- 10.20.193.78:0/2529983073 wait complete. 2026-02-13T02:43:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:38 trial078 ceph-mon[22944]: osdmap e79: 12 total, 12 up, 12 in 2026-02-13T02:43:38.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:38 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2529983073' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:38.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:38 trial154 ceph-mon[27921]: osdmap e79: 12 total, 12 up, 12 in 2026-02-13T02:43:38.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:38 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2529983073' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:38.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:38 trial091 ceph-mon[27614]: osdmap e79: 12 total, 12 up, 12 in 2026-02-13T02:43:38.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:38 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2529983073' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:39.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:39 trial154 ceph-mon[27921]: pgmap v237: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 10 op/s 2026-02-13T02:43:39.846 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:39 trial091 ceph-mon[27614]: pgmap v237: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 10 op/s 2026-02-13T02:43:39.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:39 trial078 ceph-mon[22944]: pgmap v237: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 10 op/s 2026-02-13T02:43:41.373 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:41.559 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:41.689 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:41 trial078 ceph-mon[22944]: pgmap v238: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 3 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 -- 10.20.193.78:0/2411732957 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 msgr2=0x7f58a0061110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/2411732957 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 0x7f58a0061110 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=1057399052888106128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5890009970 tx=0x7f589002ed50 comp rx=0 tx=0).stop 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 -- 10.20.193.78:0/2411732957 shutdown_connections 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/2411732957 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f58a0159910 0x7f58a0179cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/2411732957 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 0x7f58a0061110 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=1057399052888106128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/2411732957 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a00622d0 0x7f58a00607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 -- 10.20.193.78:0/2411732957 >> 10.20.193.78:0/2411732957 conn(0x7f58a00ea6d0 msgr2=0x7f58a010aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 -- 10.20.193.78:0/2411732957 shutdown_connections 2026-02-13T02:43:41.755 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.753+0000 7f58a4d866c0 1 -- 10.20.193.78:0/2411732957 wait complete. 2026-02-13T02:43:41.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 Processor -- start 2026-02-13T02:43:41.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 -- start start 2026-02-13T02:43:41.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 0x7f58a00f20b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:41.756 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f58a00622d0 0x7f58a00f25f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a0159910 0x7f58a00f79b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00f8000 con 0x7f58a0159910 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00f8170 con 0x7f58a00622d0 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.754+0000 7f58a4d866c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58a00f8330 con 0x7f58a0060ce0 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589f7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 0x7f58a00f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a0159910 0x7f58a00f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a0159910 0x7f58a00f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:59966/0 (socket says 10.20.193.78:59966) 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 -- 10.20.193.78:0/1001397390 learned_addr learned my addr 10.20.193.78:0/1001397390 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589effd6c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f58a00622d0 0x7f58a00f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 -- 10.20.193.78:0/1001397390 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 msgr2=0x7f58a00f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 0x7f58a00f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 -- 10.20.193.78:0/1001397390 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f58a00622d0 msgr2=0x7f58a00f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f58a00622d0 0x7f58a00f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 -- 10.20.193.78:0/1001397390 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5890009590 con 0x7f58a0159910 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589effd6c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f58a00622d0 0x7f58a00f25f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:43:41.757 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589ffff6c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a0159910 0x7f58a00f79b0 secure :-1 s=READY pgs=222 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5894006ea0 tx=0x7f589400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:41.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589cff96c0 1 -- 10.20.193.78:0/1001397390 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5894003c40 con 0x7f58a0159910 2026-02-13T02:43:41.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589cff96c0 1 -- 10.20.193.78:0/1001397390 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5894003da0 con 0x7f58a0159910 2026-02-13T02:43:41.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f589cff96c0 1 -- 10.20.193.78:0/1001397390 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58940081c0 con 0x7f58a0159910 2026-02-13T02:43:41.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a00f8610 con 0x7f58a0159910 2026-02-13T02:43:41.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.755+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a00f8cd0 con 0x7f58a0159910 2026-02-13T02:43:41.758 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.756+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a00f8830 con 0x7f58a0159910 2026-02-13T02:43:41.760 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.758+0000 7f589cff96c0 1 -- 10.20.193.78:0/1001397390 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f589400d590 con 0x7f58a0159910 2026-02-13T02:43:41.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.760+0000 7f589cff96c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f58740b56d0 0x7f58740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:41.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.760+0000 7f589cff96c0 1 -- 10.20.193.78:0/1001397390 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f58940e4bd0 con 0x7f58a0159910 2026-02-13T02:43:41.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.760+0000 7f589cff96c0 1 -- 10.20.193.78:0/1001397390 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f589411d660 con 0x7f58a0159910 2026-02-13T02:43:41.761 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.760+0000 7f589f7fe6c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f58740b56d0 0x7f58740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:41.762 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.760+0000 7f589f7fe6c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f58740b56d0 0x7f58740d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f588c004750 tx=0x7f588c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:41.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:41 trial154 ceph-mon[27921]: pgmap v238: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 3 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:41.883 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.882+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f58a00f3200 con 0x7f58a0159910 2026-02-13T02:43:41.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.882+0000 7f589cff96c0 1 -- 10.20.193.78:0/1001397390 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f58940a74f0 con 0x7f58a0159910 2026-02-13T02:43:41.884 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:41.884 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:41.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f58740b56d0 msgr2=0x7f58740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:41.884 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f58740b56d0 0x7f58740d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f588c004750 tx=0x7f588c009260 comp rx=0 tx=0).stop 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a0159910 msgr2=0x7f58a00f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a0159910 0x7f58a00f79b0 secure :-1 s=READY pgs=222 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5894006ea0 tx=0x7f589400ce50 comp rx=0 tx=0).stop 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 shutdown_connections 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f58740b56d0 0x7f58740d5b80 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f58a0159910 0x7f58a00f79b0 unknown :-1 s=CLOSED pgs=222 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f58a00622d0 0x7f58a00f25f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 --2- 10.20.193.78:0/1001397390 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58a0060ce0 0x7f58a00f20b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 >> 10.20.193.78:0/1001397390 conn(0x7f58a00ea6d0 msgr2=0x7f58a010ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 shutdown_connections 2026-02-13T02:43:41.885 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:41.883+0000 7f58a4d866c0 1 -- 10.20.193.78:0/1001397390 wait complete. 2026-02-13T02:43:41.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:41 trial091 ceph-mon[27614]: pgmap v238: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 3 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:42.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:42 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1001397390' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:42.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:42 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1001397390' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:42.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:42 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1001397390' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:43.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:43 trial154 ceph-mon[27921]: pgmap v239: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 6 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:43.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:43 trial091 ceph-mon[27614]: pgmap v239: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 6 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:43.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:43 trial078 ceph-mon[22944]: pgmap v239: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 6 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:44.985 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:45.169 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 -- 10.20.193.78:0/421073169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa258114190 msgr2=0x7fa258119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/421073169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa258114190 0x7fa258119140 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=9880517629545365831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa240009970 tx=0x7fa24002ed50 comp rx=0 tx=0).stop 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 -- 10.20.193.78:0/421073169 shutdown_connections 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/421073169 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2581198f0 0x7fa25817a2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/421073169 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa258114190 0x7fa258119140 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=9880517629545365831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/421073169 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa2581137a0 0x7fa258113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 -- 10.20.193.78:0/421073169 >> 10.20.193.78:0/421073169 conn(0x7fa258060760 msgr2=0x7fa258060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 -- 10.20.193.78:0/421073169 shutdown_connections 2026-02-13T02:43:45.366 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.364+0000 7fa25d5476c0 1 -- 10.20.193.78:0/421073169 wait complete. 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 Processor -- start 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 -- start start 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2581137a0 0x7fa258121640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2581198f0 0x7fa258121b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa258126f40 0x7fa2581273e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa258127950 con 0x7fa2581198f0 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa258127ac0 con 0x7fa258126f40 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa25d5476c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa258127c80 con 0x7fa2581137a0 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa2567fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2581198f0 0x7fa258121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:45.367 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa256ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2581137a0 0x7fa258121640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa2577fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa258126f40 0x7fa2581273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa2567fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2581198f0 0x7fa258121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:59970/0 (socket says 10.20.193.78:59970) 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa2567fc6c0 1 -- 10.20.193.78:0/1518398695 learned_addr learned my addr 10.20.193.78:0/1518398695 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.365+0000 7fa256ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2581137a0 0x7fa258121640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:39080/0 (socket says 10.20.193.78:39080) 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa2577fe6c0 1 -- 10.20.193.78:0/1518398695 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2581137a0 msgr2=0x7fa258121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa2577fe6c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2581137a0 0x7fa258121640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa2577fe6c0 1 -- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2581198f0 msgr2=0x7fa258121b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa2577fe6c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2581198f0 0x7fa258121b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa2577fe6c0 1 -- 10.20.193.78:0/1518398695 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa240009590 con 0x7fa258126f40 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa2567fc6c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2581198f0 0x7fa258121b80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa2577fe6c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa258126f40 0x7fa2581273e0 secure :-1 s=READY pgs=147 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa248006fd0 tx=0x7fa24800cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa237fff6c0 1 -- 10.20.193.78:0/1518398695 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa248003c40 con 0x7fa258126f40 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa237fff6c0 1 -- 10.20.193.78:0/1518398695 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa24800a070 con 0x7fa258126f40 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa237fff6c0 1 -- 10.20.193.78:0/1518398695 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa24800dd90 con 0x7fa258126f40 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa258168130 con 0x7fa258126f40 2026-02-13T02:43:45.368 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.366+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2581685c0 con 0x7fa258126f40 2026-02-13T02:43:45.369 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.367+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2581149e0 con 0x7fa258126f40 2026-02-13T02:43:45.370 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.369+0000 7fa237fff6c0 1 -- 10.20.193.78:0/1518398695 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa248005030 con 0x7fa258126f40 2026-02-13T02:43:45.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.371+0000 7fa237fff6c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa22c0b5650 0x7fa22c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:45.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.371+0000 7fa237fff6c0 1 -- 10.20.193.78:0/1518398695 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fa2480e4b40 con 0x7fa258126f40 2026-02-13T02:43:45.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.371+0000 7fa256ffd6c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa22c0b5650 0x7fa22c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:45.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.371+0000 7fa237fff6c0 1 -- 10.20.193.78:0/1518398695 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa24811d5e0 con 0x7fa258126f40 2026-02-13T02:43:45.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.371+0000 7fa256ffd6c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa22c0b5650 0x7fa22c0d5b00 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa24c004750 tx=0x7fa24c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:45.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.494+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa258113b70 con 0x7fa258126f40 2026-02-13T02:43:45.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.495+0000 7fa237fff6c0 1 -- 10.20.193.78:0/1518398695 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa2480a7460 con 0x7fa258126f40 2026-02-13T02:43:45.496 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:45.496 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:45.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa22c0b5650 msgr2=0x7fa22c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:45.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa22c0b5650 0x7fa22c0d5b00 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa24c004750 tx=0x7fa24c009260 comp rx=0 tx=0).stop 2026-02-13T02:43:45.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa258126f40 msgr2=0x7fa2581273e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:45.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa258126f40 0x7fa2581273e0 secure :-1 s=READY pgs=147 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa248006fd0 tx=0x7fa24800cc00 comp rx=0 tx=0).stop 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 shutdown_connections 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa22c0b5650 0x7fa22c0d5b00 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa258126f40 0x7fa2581273e0 unknown :-1 s=CLOSED pgs=147 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa2581198f0 0x7fa258121b80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 --2- 10.20.193.78:0/1518398695 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa2581137a0 0x7fa258121640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 >> 10.20.193.78:0/1518398695 conn(0x7fa258060760 msgr2=0x7fa258115f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 shutdown_connections 2026-02-13T02:43:45.498 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:45.496+0000 7fa25d5476c0 1 -- 10.20.193.78:0/1518398695 wait complete. 2026-02-13T02:43:45.558 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:45 trial078 ceph-mon[22944]: pgmap v240: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 6 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:45.558 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:45 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1518398695' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:45.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:45 trial154 ceph-mon[27921]: pgmap v240: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 6 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:45.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:45 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1518398695' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:45 trial091 ceph-mon[27614]: pgmap v240: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 6 op/s; 301 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:45 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1518398695' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:47.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:47 trial154 ceph-mon[27921]: pgmap v241: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 244 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:47.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:47 trial091 ceph-mon[27614]: pgmap v241: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 244 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:47.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:47 trial078 ceph-mon[22944]: pgmap v241: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 244 B/s, 1 keys/s, 1 objects/s recovering 2026-02-13T02:43:48.599 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:48.781 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:48.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.973+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/2375423476 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca8410fa50 msgr2=0x7fca84114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:48.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.973+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/2375423476 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca8410fa50 0x7fca84114a90 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=5806008635047002762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca78009970 tx=0x7fca7802ed10 comp rx=0 tx=0).stop 2026-02-13T02:43:48.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.974+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/2375423476 shutdown_connections 2026-02-13T02:43:48.975 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.974+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/2375423476 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca84115270 0x7fca84175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.974+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/2375423476 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca8410fa50 0x7fca84114a90 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=5806008635047002762 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.974+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/2375423476 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca8410f060 0x7fca8410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.974+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/2375423476 >> 10.20.193.78:0/2375423476 conn(0x7fca840ec980 msgr2=0x7fca8410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.974+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/2375423476 shutdown_connections 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.974+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/2375423476 wait complete. 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 Processor -- start 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 -- start start 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca8410f060 0x7fca840f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca84115270 0x7fca84175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca840f4fc0 0x7fca840fa290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca840f56b0 con 0x7fca84115270 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fca840fa7d0 con 0x7fca840f4fc0 2026-02-13T02:43:48.976 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8af2a6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca840fa990 con 0x7fca8410f060 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca8410f060 0x7fca840f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca8410f060 0x7fca840f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:49592/0 (socket says 10.20.193.78:49592) 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 -- 10.20.193.78:0/3481000634 learned_addr learned my addr 10.20.193.78:0/3481000634 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca8a7296c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca840f4fc0 0x7fca840fa290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca897276c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca84115270 0x7fca84175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 -- 10.20.193.78:0/3481000634 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca840f4fc0 msgr2=0x7fca840fa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca840f4fc0 0x7fca840fa290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 -- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca84115270 msgr2=0x7fca84175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca84115270 0x7fca84175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.975+0000 7fca89f286c0 1 -- 10.20.193.78:0/3481000634 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8000a5b0 con 0x7fca8410f060 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca897276c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca84115270 0x7fca84175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca89f286c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca8410f060 0x7fca840f4990 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca74009fd0 tx=0x7fca7400bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca72ffd6c0 1 -- 10.20.193.78:0/3481000634 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca74004a80 con 0x7fca8410f060 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca72ffd6c0 1 -- 10.20.193.78:0/3481000634 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca74009030 con 0x7fca8410f060 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca72ffd6c0 1 -- 10.20.193.78:0/3481000634 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca740056e0 con 0x7fca8410f060 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca78009590 con 0x7fca8410f060 2026-02-13T02:43:48.977 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca840faf70 con 0x7fca8410f060 2026-02-13T02:43:48.978 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.976+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca84110330 con 0x7fca8410f060 2026-02-13T02:43:48.980 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.979+0000 7fca72ffd6c0 1 -- 10.20.193.78:0/3481000634 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fca74004c70 con 0x7fca8410f060 2026-02-13T02:43:48.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.981+0000 7fca72ffd6c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fca600b5650 0x7fca600d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:48.982 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.981+0000 7fca72ffd6c0 1 -- 10.20.193.78:0/3481000634 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fca740e3d30 con 0x7fca8410f060 2026-02-13T02:43:48.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.981+0000 7fca72ffd6c0 1 -- 10.20.193.78:0/3481000634 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fca740e41b0 con 0x7fca8410f060 2026-02-13T02:43:48.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.981+0000 7fca897276c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fca600b5650 0x7fca600d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:48.983 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:48.982+0000 7fca897276c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fca600b5650 0x7fca600d5b00 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca780023e0 tx=0x7fca78005ca0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:49.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.105+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fca8410f430 con 0x7fca8410f060 2026-02-13T02:43:49.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.105+0000 7fca72ffd6c0 1 -- 10.20.193.78:0/3481000634 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fca740a6650 con 0x7fca8410f060 2026-02-13T02:43:49.107 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:49.107 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:49.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.106+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fca600b5650 msgr2=0x7fca600d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:49.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.106+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fca600b5650 0x7fca600d5b00 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca780023e0 tx=0x7fca78005ca0 comp rx=0 tx=0).stop 2026-02-13T02:43:49.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.106+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca8410f060 msgr2=0x7fca840f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:49.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.106+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca8410f060 0x7fca840f4990 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca74009fd0 tx=0x7fca7400bca0 comp rx=0 tx=0).stop 2026-02-13T02:43:49.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 shutdown_connections 2026-02-13T02:43:49.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fca600b5650 0x7fca600d5b00 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:49.108 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fca840f4fc0 0x7fca840fa290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:49.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca84115270 0x7fca84175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:49.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 --2- 10.20.193.78:0/3481000634 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fca8410f060 0x7fca840f4990 unknown :-1 s=CLOSED pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:49.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 >> 10.20.193.78:0/3481000634 conn(0x7fca840ec980 msgr2=0x7fca841138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:49.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 shutdown_connections 2026-02-13T02:43:49.109 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:49.107+0000 7fca8af2a6c0 1 -- 10.20.193.78:0/3481000634 wait complete. 2026-02-13T02:43:49.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:49 trial154 ceph-mon[27921]: pgmap v242: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 222 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:43:49.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:49 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3481000634' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:49 trial091 ceph-mon[27614]: pgmap v242: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 222 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:43:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:49 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3481000634' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:49.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:49 trial078 ceph-mon[22944]: pgmap v242: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 222 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:43:49.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:49 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3481000634' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:51.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:51 trial091 ceph-mon[27614]: pgmap v243: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 6 op/s; 201 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:43:51.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:51 trial078 ceph-mon[22944]: pgmap v243: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 6 op/s; 201 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:43:52.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:51 trial154 ceph-mon[27921]: pgmap v243: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 6 op/s; 201 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:43:52.210 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:52.396 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:52.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 -- 10.20.193.78:0/4151752142 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580116380 msgr2=0x7fa58011b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 --2- 10.20.193.78:0/4151752142 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580116380 0x7fa58011b3c0 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=9589423185055741562 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5680098d0 tx=0x7fa56802ec30 comp rx=0 tx=0).stop 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 -- 10.20.193.78:0/4151752142 shutdown_connections 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 --2- 10.20.193.78:0/4151752142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa58011bba0 0x7fa58017c540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 --2- 10.20.193.78:0/4151752142 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580116380 0x7fa58011b3c0 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=9589423185055741562 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 --2- 10.20.193.78:0/4151752142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa580115990 0x7fa580115d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 -- 10.20.193.78:0/4151752142 >> 10.20.193.78:0/4151752142 conn(0x7fa58005e060 msgr2=0x7fa58005e460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 -- 10.20.193.78:0/4151752142 shutdown_connections 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.584+0000 7fa5855606c0 1 -- 10.20.193.78:0/4151752142 wait complete. 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 Processor -- start 2026-02-13T02:43:52.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 -- start start 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580115990 0x7fa5800fd5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa58011bba0 0x7fa58017c440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa5800fdc00 0x7fa580102ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5800fe2f0 con 0x7fa580115990 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa580103410 con 0x7fa5800fdc00 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa5855606c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801035d0 con 0x7fa58011bba0 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa57effd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580115990 0x7fa5800fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa57effd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580115990 0x7fa5800fd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:51856/0 (socket says 10.20.193.78:51856) 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa57effd6c0 1 -- 10.20.193.78:0/3951679567 learned_addr learned my addr 10.20.193.78:0/3951679567 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:52.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.585+0000 7fa57e7fc6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa58011bba0 0x7fa58017c440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa57f7fe6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa5800fdc00 0x7fa580102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa57effd6c0 1 -- 10.20.193.78:0/3951679567 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa58011bba0 msgr2=0x7fa58017c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa57effd6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa58011bba0 0x7fa58017c440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa57effd6c0 1 -- 10.20.193.78:0/3951679567 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa5800fdc00 msgr2=0x7fa580102ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa57effd6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa5800fdc00 0x7fa580102ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa57effd6c0 1 -- 10.20.193.78:0/3951679567 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5680094c0 con 0x7fa580115990 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa57effd6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580115990 0x7fa5800fd5d0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa574005950 tx=0x7fa57400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa55ffff6c0 1 -- 10.20.193.78:0/3951679567 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa574004460 con 0x7fa580115990 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa55ffff6c0 1 -- 10.20.193.78:0/3951679567 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa5740045c0 con 0x7fa580115990 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa55ffff6c0 1 -- 10.20.193.78:0/3951679567 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa574003960 con 0x7fa580115990 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5801038b0 con 0x7fa580115990 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.586+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa580103d40 con 0x7fa580115990 2026-02-13T02:43:52.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.587+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa580116c60 con 0x7fa580115990 2026-02-13T02:43:52.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.589+0000 7fa55ffff6c0 1 -- 10.20.193.78:0/3951679567 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa5740050b0 con 0x7fa580115990 2026-02-13T02:43:52.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.590+0000 7fa55ffff6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5540b56d0 0x7fa5540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:52.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.590+0000 7fa55ffff6c0 1 -- 10.20.193.78:0/3951679567 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fa5740e39a0 con 0x7fa580115990 2026-02-13T02:43:52.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.590+0000 7fa57e7fc6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5540b56d0 0x7fa5540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:52.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.590+0000 7fa55ffff6c0 1 -- 10.20.193.78:0/3951679567 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa5740e3e20 con 0x7fa580115990 2026-02-13T02:43:52.592 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.591+0000 7fa57e7fc6c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5540b56d0 0x7fa5540d5b80 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa580103f60 tx=0x7fa5680023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:52.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.715+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa580115d60 con 0x7fa580115990 2026-02-13T02:43:52.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.716+0000 7fa55ffff6c0 1 -- 10.20.193.78:0/3951679567 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa5740a62c0 con 0x7fa580115990 2026-02-13T02:43:52.718 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:52.718 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.717+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5540b56d0 msgr2=0x7fa5540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.717+0000 7fa5855606c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5540b56d0 0x7fa5540d5b80 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa580103f60 tx=0x7fa5680023a0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.717+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580115990 msgr2=0x7fa5800fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.717+0000 7fa5855606c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580115990 0x7fa5800fd5d0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa574005950 tx=0x7fa57400bca0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 shutdown_connections 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5540b56d0 0x7fa5540d5b80 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa5800fdc00 0x7fa580102ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa58011bba0 0x7fa58017c440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 --2- 10.20.193.78:0/3951679567 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa580115990 0x7fa5800fd5d0 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:52.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 >> 10.20.193.78:0/3951679567 conn(0x7fa58005e060 msgr2=0x7fa58011a220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:52.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 shutdown_connections 2026-02-13T02:43:52.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:52.718+0000 7fa5855606c0 1 -- 10.20.193.78:0/3951679567 wait complete. 2026-02-13T02:43:52.779 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:52 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:43:52.783 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:52 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:43:52.787 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:52 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:43:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:53 trial091 ceph-mon[27614]: pgmap v244: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:43:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:53 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3951679567' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:53 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:53 trial078 ceph-mon[22944]: pgmap v244: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:43:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:53 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3951679567' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:53 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:53 trial154 ceph-mon[27921]: pgmap v244: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:43:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:53 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3951679567' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:53 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:43:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:54 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:43:54.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:43:54.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:43:54.964 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.964 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:43:54.964 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:43:54.964 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:54 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:43:54.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:54 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:43:55.826 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:55 trial091 ceph-mon[27614]: pgmap v245: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:55 trial091 ceph-mon[27614]: pgmap v246: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:55 trial091 ceph-mon[27614]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:43:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:55 trial091 ceph-mon[27614]: Cluster is now healthy 2026-02-13T02:43:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:55 trial078 ceph-mon[22944]: pgmap v245: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:55 trial078 ceph-mon[22944]: pgmap v246: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:55 trial078 ceph-mon[22944]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:43:55.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:55 trial078 ceph-mon[22944]: Cluster is now healthy 2026-02-13T02:43:56.012 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:56.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:55 trial154 ceph-mon[27921]: pgmap v245: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:55 trial154 ceph-mon[27921]: pgmap v246: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:43:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:55 trial154 ceph-mon[27921]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:43:56.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:55 trial154 ceph-mon[27921]: Cluster is now healthy 2026-02-13T02:43:56.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/1596631587 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa93811b510 msgr2=0x7fa93811b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:56.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/1596631587 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa93811b510 0x7fa93811b8e0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=869366232512403258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa92c0098a0 tx=0x7fa92c02ec40 comp rx=0 tx=0).stop 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/1596631587 shutdown_connections 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/1596631587 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa9381149c0 0x7fa938114ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/1596631587 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa938113dc0 0x7fa938114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/1596631587 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa93811b510 0x7fa93811b8e0 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=869366232512403258 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/1596631587 >> 10.20.193.78:0/1596631587 conn(0x7fa938058a50 msgr2=0x7fa938058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/1596631587 shutdown_connections 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/1596631587 wait complete. 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.205+0000 7fa93d6b16c0 1 Processor -- start 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa93d6b16c0 1 -- start start 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa93d6b16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa938113dc0 0x7fa93812b7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa93d6b16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9381149c0 0x7fa93812bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa93d6b16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa93811b510 0x7fa9381310e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa93d6b16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa938131730 con 0x7fa9381149c0 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa93d6b16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa9381318a0 con 0x7fa93811b510 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa93d6b16c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa938131a60 con 0x7fa938113dc0 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa936ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa938113dc0 0x7fa93812b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa93811b510 0x7fa9381310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa93811b510 0x7fa9381310e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:40156/0 (socket says 10.20.193.78:40156) 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 -- 10.20.193.78:0/452456733 learned_addr learned my addr 10.20.193.78:0/452456733 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:56.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9367fc6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9381149c0 0x7fa93812bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 -- 10.20.193.78:0/452456733 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa938113dc0 msgr2=0x7fa93812b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa938113dc0 0x7fa93812b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 -- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9381149c0 msgr2=0x7fa93812bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9381149c0 0x7fa93812bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9377fe6c0 1 -- 10.20.193.78:0/452456733 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c0094c0 con 0x7fa93811b510 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.206+0000 7fa9367fc6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9381149c0 0x7fa93812bd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.207+0000 7fa9377fe6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa93811b510 0x7fa9381310e0 secure :-1 s=READY pgs=149 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa92800c9b0 tx=0x7fa92800ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.207+0000 7fa917fff6c0 1 -- 10.20.193.78:0/452456733 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa928003c40 con 0x7fa93811b510 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.207+0000 7fa917fff6c0 1 -- 10.20.193.78:0/452456733 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa92800a070 con 0x7fa93811b510 2026-02-13T02:43:56.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.207+0000 7fa917fff6c0 1 -- 10.20.193.78:0/452456733 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9280081c0 con 0x7fa93811b510 2026-02-13T02:43:56.210 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.207+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa938131d40 con 0x7fa93811b510 2026-02-13T02:43:56.210 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.207+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa938172420 con 0x7fa93811b510 2026-02-13T02:43:56.210 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.207+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa938131f60 con 0x7fa93811b510 2026-02-13T02:43:56.211 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.210+0000 7fa917fff6c0 1 -- 10.20.193.78:0/452456733 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa92800d590 con 0x7fa93811b510 2026-02-13T02:43:56.212 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.211+0000 7fa917fff6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa9100b5650 0x7fa9100d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:56.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.211+0000 7fa917fff6c0 1 -- 10.20.193.78:0/452456733 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fa9280e4bd0 con 0x7fa93811b510 2026-02-13T02:43:56.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.211+0000 7fa936ffd6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa9100b5650 0x7fa9100d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:56.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.211+0000 7fa917fff6c0 1 -- 10.20.193.78:0/452456733 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa92811d660 con 0x7fa93811b510 2026-02-13T02:43:56.213 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.212+0000 7fa936ffd6c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa9100b5650 0x7fa9100d5b00 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa92c0097f0 tx=0x7fa92c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:56.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.337+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa93812c930 con 0x7fa93811b510 2026-02-13T02:43:56.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.337+0000 7fa917fff6c0 1 -- 10.20.193.78:0/452456733 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa9280a7580 con 0x7fa93811b510 2026-02-13T02:43:56.338 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:56.339 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:56.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa9100b5650 msgr2=0x7fa9100d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:56.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa9100b5650 0x7fa9100d5b00 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa92c0097f0 tx=0x7fa92c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa93811b510 msgr2=0x7fa9381310e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa93811b510 0x7fa9381310e0 secure :-1 s=READY pgs=149 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa92800c9b0 tx=0x7fa92800ce80 comp rx=0 tx=0).stop 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 shutdown_connections 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa9100b5650 0x7fa9100d5b00 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa93811b510 0x7fa9381310e0 unknown :-1 s=CLOSED pgs=149 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9381149c0 0x7fa93812bd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 --2- 10.20.193.78:0/452456733 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa938113dc0 0x7fa93812b7e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 >> 10.20.193.78:0/452456733 conn(0x7fa938058a50 msgr2=0x7fa9381176b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 shutdown_connections 2026-02-13T02:43:56.340 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:56.338+0000 7fa93d6b16c0 1 -- 10.20.193.78:0/452456733 wait complete. 2026-02-13T02:43:56.686 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:56 trial078 ceph-mon[22944]: pgmap v247: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:43:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:56 trial091 ceph-mon[27614]: pgmap v247: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:43:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:56 trial091 ceph-mon[27614]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:43:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:56 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/452456733' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:56.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:56 trial078 ceph-mon[22944]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:43:56.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:56 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/452456733' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:57.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:56 trial154 ceph-mon[27921]: pgmap v247: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:43:57.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:56 trial154 ceph-mon[27921]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:43:57.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:56 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/452456733' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:43:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:43:58 trial091 ceph-mon[27614]: pgmap v248: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:43:58.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:43:58 trial078 ceph-mon[22944]: pgmap v248: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:43:59.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:43:58 trial154 ceph-mon[27921]: pgmap v248: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:43:59.442 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:43:59.621 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 -- 10.20.193.78:0/1102700984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 msgr2=0x7fcd0c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 --2- 10.20.193.78:0/1102700984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 0x7fcd0c10f430 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=3184502965478380575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccfc009970 tx=0x7fccfc02ed10 comp rx=0 tx=0).stop 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 -- 10.20.193.78:0/1102700984 shutdown_connections 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 --2- 10.20.193.78:0/1102700984 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 0x7fcd0c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 --2- 10.20.193.78:0/1102700984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd0c10fa50 0x7fcd0c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 --2- 10.20.193.78:0/1102700984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 0x7fcd0c10f430 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=3184502965478380575 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 -- 10.20.193.78:0/1102700984 >> 10.20.193.78:0/1102700984 conn(0x7fcd0c0ec980 msgr2=0x7fcd0c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 -- 10.20.193.78:0/1102700984 shutdown_connections 2026-02-13T02:43:59.810 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.808+0000 7fcd130586c0 1 -- 10.20.193.78:0/1102700984 wait complete. 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 Processor -- start 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 -- start start 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 0x7fcd0c11cf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 0x7fcd0c11d490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd0c122850 0x7fcd0c122cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c123260 con 0x7fcd0c122850 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c1233d0 con 0x7fcd0c10f060 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd130586c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c123590 con 0x7fcd0c115270 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd118556c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 0x7fcd0c11d490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd118556c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 0x7fcd0c11d490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45302/0 (socket says 10.20.193.78:45302) 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd118556c0 1 -- 10.20.193.78:0/3841611034 learned_addr learned my addr 10.20.193.78:0/3841611034 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd120566c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 0x7fcd0c11cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:59.811 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.809+0000 7fcd128576c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd0c122850 0x7fcd0c122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd118556c0 1 -- 10.20.193.78:0/3841611034 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 msgr2=0x7fcd0c11cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd118556c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 0x7fcd0c11cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd118556c0 1 -- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd0c122850 msgr2=0x7fcd0c122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd118556c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd0c122850 0x7fcd0c122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd118556c0 1 -- 10.20.193.78:0/3841611034 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd000094c0 con 0x7fcd0c115270 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd120566c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 0x7fcd0c11cf50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd118556c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 0x7fcd0c11d490 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd0000ba30 tx=0x7fcd0000bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fccf37fe6c0 1 -- 10.20.193.78:0/3841611034 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd000044a0 con 0x7fcd0c115270 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fccf37fe6c0 1 -- 10.20.193.78:0/3841611034 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcd00009030 con 0x7fcd0c115270 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccfc009590 con 0x7fcd0c115270 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fccf37fe6c0 1 -- 10.20.193.78:0/3841611034 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd000071c0 con 0x7fcd0c115270 2026-02-13T02:43:59.812 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.810+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c163d40 con 0x7fcd0c115270 2026-02-13T02:43:59.813 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.811+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c110330 con 0x7fcd0c115270 2026-02-13T02:43:59.814 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.813+0000 7fccf37fe6c0 1 -- 10.20.193.78:0/3841611034 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fcd000048a0 con 0x7fcd0c115270 2026-02-13T02:43:59.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.815+0000 7fccf37fe6c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcce80b5650 0x7fcce80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:43:59.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.815+0000 7fccf37fe6c0 1 -- 10.20.193.78:0/3841611034 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fcd000e3d80 con 0x7fcd0c115270 2026-02-13T02:43:59.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.815+0000 7fcd120566c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcce80b5650 0x7fcce80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:43:59.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.815+0000 7fccf37fe6c0 1 -- 10.20.193.78:0/3841611034 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcd000e4200 con 0x7fcd0c115270 2026-02-13T02:43:59.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.816+0000 7fcd120566c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcce80b5650 0x7fcce80d5b00 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccfc0023e0 tx=0x7fccfc005de0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:43:59.939 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.938+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd0c10f430 con 0x7fcd0c115270 2026-02-13T02:43:59.940 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.938+0000 7fccf37fe6c0 1 -- 10.20.193.78:0/3841611034 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fcd000a66a0 con 0x7fcd0c115270 2026-02-13T02:43:59.940 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:43:59.940 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcce80b5650 msgr2=0x7fcce80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcce80b5650 0x7fcce80d5b00 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccfc0023e0 tx=0x7fccfc005de0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 msgr2=0x7fcd0c11d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 0x7fcd0c11d490 secure :-1 s=READY pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd0000ba30 tx=0x7fcd0000bf00 comp rx=0 tx=0).stop 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 shutdown_connections 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fcce80b5650 0x7fcce80d5b00 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcd0c122850 0x7fcd0c122cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd0c115270 0x7fcd0c11d490 unknown :-1 s=CLOSED pgs=125 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 --2- 10.20.193.78:0/3841611034 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd0c10f060 0x7fcd0c11cf50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 >> 10.20.193.78:0/3841611034 conn(0x7fcd0c0ec980 msgr2=0x7fcd0c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.939+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 shutdown_connections 2026-02-13T02:43:59.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:43:59.940+0000 7fcd130586c0 1 -- 10.20.193.78:0/3841611034 wait complete. 2026-02-13T02:44:00.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:00 trial091 ceph-mon[27614]: pgmap v249: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T02:44:00.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:00 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3841611034' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:00.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:00 trial078 ceph-mon[22944]: pgmap v249: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T02:44:00.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:00 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3841611034' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:01.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:00 trial154 ceph-mon[27921]: pgmap v249: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T02:44:01.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:00 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3841611034' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:02.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:02 trial091 ceph-mon[27614]: pgmap v250: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T02:44:02.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:02 trial078 ceph-mon[22944]: pgmap v250: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T02:44:03.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:02 trial154 ceph-mon[27921]: pgmap v250: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T02:44:03.048 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:03.232 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:03.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 -- 10.20.193.78:0/3118507768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa51410fa50 msgr2=0x7fa514114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:03.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 --2- 10.20.193.78:0/3118507768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa51410fa50 0x7fa514114a90 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=15855818434781221323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5040099a0 tx=0x7fa50402ed00 comp rx=0 tx=0).stop 2026-02-13T02:44:03.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 -- 10.20.193.78:0/3118507768 shutdown_connections 2026-02-13T02:44:03.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 --2- 10.20.193.78:0/3118507768 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa514115270 0x7fa514175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 --2- 10.20.193.78:0/3118507768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa51410fa50 0x7fa514114a90 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=15855818434781221323 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 --2- 10.20.193.78:0/3118507768 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa51410f060 0x7fa51410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 -- 10.20.193.78:0/3118507768 >> 10.20.193.78:0/3118507768 conn(0x7fa5140ec980 msgr2=0x7fa51410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:03.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.422+0000 7fa51957a6c0 1 -- 10.20.193.78:0/3118507768 shutdown_connections 2026-02-13T02:44:03.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.423+0000 7fa51957a6c0 1 -- 10.20.193.78:0/3118507768 wait complete. 2026-02-13T02:44:03.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 Processor -- start 2026-02-13T02:44:03.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 -- start start 2026-02-13T02:44:03.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa51410f060 0x7fa5140f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:03.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa514115270 0x7fa514175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:03.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa5140f4ff0 0x7fa5140fa2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:03.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140f56e0 con 0x7fa51410f060 2026-02-13T02:44:03.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140fa800 con 0x7fa514115270 2026-02-13T02:44:03.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa51957a6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140fa9c0 con 0x7fa5140f4ff0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa518d796c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa5140f4ff0 0x7fa5140fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa513fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa51410f060 0x7fa5140f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa518d796c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa5140f4ff0 0x7fa5140fa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:45324/0 (socket says 10.20.193.78:45324) 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa518d796c0 1 -- 10.20.193.78:0/3163832038 learned_addr learned my addr 10.20.193.78:0/3163832038 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.424+0000 7fa5137fe6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa514115270 0x7fa514175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa518d796c0 1 -- 10.20.193.78:0/3163832038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa514115270 msgr2=0x7fa514175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa518d796c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa514115270 0x7fa514175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa518d796c0 1 -- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa51410f060 msgr2=0x7fa5140f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa518d796c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa51410f060 0x7fa5140f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa518d796c0 1 -- 10.20.193.78:0/3163832038 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50800a5b0 con 0x7fa5140f4ff0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa5137fe6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa514115270 0x7fa514175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa518d796c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa5140f4ff0 0x7fa5140fa2c0 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa50800c9b0 tx=0x7fa50800ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa5117fa6c0 1 -- 10.20.193.78:0/3163832038 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa508003c40 con 0x7fa5140f4ff0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa51957a6c0 1 -- 10.20.193.78:0/3163832038 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa504009590 con 0x7fa5140f4ff0 2026-02-13T02:44:03.427 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa51957a6c0 1 -- 10.20.193.78:0/3163832038 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5140faff0 con 0x7fa5140f4ff0 2026-02-13T02:44:03.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa5117fa6c0 1 -- 10.20.193.78:0/3163832038 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa50800a070 con 0x7fa5140f4ff0 2026-02-13T02:44:03.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.425+0000 7fa5117fa6c0 1 -- 10.20.193.78:0/3163832038 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5080081c0 con 0x7fa5140f4ff0 2026-02-13T02:44:03.428 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.426+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa514110330 con 0x7fa5140f4ff0 2026-02-13T02:44:03.429 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.428+0000 7fa5117fa6c0 1 -- 10.20.193.78:0/3163832038 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa50800d740 con 0x7fa5140f4ff0 2026-02-13T02:44:03.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.430+0000 7fa5117fa6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4e80b56d0 0x7fa4e80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:03.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.430+0000 7fa5117fa6c0 1 -- 10.20.193.78:0/3163832038 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fa5080e4d70 con 0x7fa5140f4ff0 2026-02-13T02:44:03.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.430+0000 7fa513fff6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4e80b56d0 0x7fa4e80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:03.431 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.430+0000 7fa5117fa6c0 1 -- 10.20.193.78:0/3163832038 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa5080e51f0 con 0x7fa5140f4ff0 2026-02-13T02:44:03.432 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.430+0000 7fa513fff6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4e80b56d0 0x7fa4e80d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa500004750 tx=0x7fa500009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:03.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.555+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa5140f5b10 con 0x7fa5140f4ff0 2026-02-13T02:44:03.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.555+0000 7fa5117fa6c0 1 -- 10.20.193.78:0/3163832038 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa5080a7690 con 0x7fa5140f4ff0 2026-02-13T02:44:03.558 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:03.559 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4e80b56d0 msgr2=0x7fa4e80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4e80b56d0 0x7fa4e80d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa500004750 tx=0x7fa500009260 comp rx=0 tx=0).stop 2026-02-13T02:44:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa5140f4ff0 msgr2=0x7fa5140fa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa5140f4ff0 0x7fa5140fa2c0 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa50800c9b0 tx=0x7fa50800ce80 comp rx=0 tx=0).stop 2026-02-13T02:44:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 shutdown_connections 2026-02-13T02:44:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4e80b56d0 0x7fa4e80d5b80 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.561 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa5140f4ff0 0x7fa5140fa2c0 unknown :-1 s=CLOSED pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa514115270 0x7fa514175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 --2- 10.20.193.78:0/3163832038 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa51410f060 0x7fa5140f49c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:03.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.556+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 >> 10.20.193.78:0/3163832038 conn(0x7fa5140ec980 msgr2=0x7fa51410d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:03.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.557+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 shutdown_connections 2026-02-13T02:44:03.562 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:03.557+0000 7fa4e6ffd6c0 1 -- 10.20.193.78:0/3163832038 wait complete. 2026-02-13T02:44:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3163832038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3163832038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:04.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3163832038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:04.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:04 trial078 ceph-mon[22944]: pgmap v251: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 10 op/s 2026-02-13T02:44:05.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:04 trial154 ceph-mon[27921]: pgmap v251: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 10 op/s 2026-02-13T02:44:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:04 trial091 ceph-mon[27614]: pgmap v251: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 10 op/s 2026-02-13T02:44:06.667 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:06.851 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:06.894 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:06 trial078 ceph-mon[22944]: pgmap v252: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 10 op/s 2026-02-13T02:44:07.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:06 trial154 ceph-mon[27921]: pgmap v252: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 10 op/s 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 -- 10.20.193.78:0/3785290236 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc115410 msgr2=0x7f94dc175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/3785290236 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc115410 0x7f94dc175db0 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=13918086502374220046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94d800aa70 tx=0x7f94d802fdd0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 -- 10.20.193.78:0/3785290236 shutdown_connections 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/3785290236 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc115410 0x7f94dc175db0 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=13918086502374220046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/3785290236 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc10fbf0 0x7f94dc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/3785290236 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc10f200 0x7f94dc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 -- 10.20.193.78:0/3785290236 >> 10.20.193.78:0/3785290236 conn(0x7f94dc0ecb00 msgr2=0x7f94dc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 -- 10.20.193.78:0/3785290236 shutdown_connections 2026-02-13T02:44:07.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.050+0000 7f94e34e16c0 1 -- 10.20.193.78:0/3785290236 wait complete. 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.051+0000 7f94e34e16c0 1 Processor -- start 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.051+0000 7f94e34e16c0 1 -- start start 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e34e16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc10f200 0x7f94dc0fe2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e34e16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc115410 0x7f94dc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e34e16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc0fe820 0x7f94dc0fecc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e34e16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc1033f0 con 0x7f94dc10f200 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e34e16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc103560 con 0x7f94dc0fe820 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e34e16c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc103720 con 0x7f94dc115410 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc0fe820 0x7f94dc0fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e12526c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc10f200 0x7f94dc0fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc0fe820 0x7f94dc0fecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:50826/0 (socket says 10.20.193.78:50826) 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 -- 10.20.193.78:0/2855403329 learned_addr learned my addr 10.20.193.78:0/2855403329 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:07.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e0a516c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc115410 0x7f94dc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 -- 10.20.193.78:0/2855403329 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc115410 msgr2=0x7f94dc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc115410 0x7f94dc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 -- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc10f200 msgr2=0x7f94dc0fe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc10f200 0x7f94dc0fe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 -- 10.20.193.78:0/2855403329 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d800a660 con 0x7f94dc0fe820 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.052+0000 7f94e1a536c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc0fe820 0x7f94dc0fecc0 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94d800ab70 tx=0x7f94d80054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.053+0000 7f94ca7fc6c0 1 -- 10.20.193.78:0/2855403329 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94d80081c0 con 0x7f94dc0fe820 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.053+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc1039a0 con 0x7f94dc0fe820 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.053+0000 7f94ca7fc6c0 1 -- 10.20.193.78:0/2855403329 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94d80309a0 con 0x7f94dc0fe820 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.053+0000 7f94ca7fc6c0 1 -- 10.20.193.78:0/2855403329 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94d8032850 con 0x7f94dc0fe820 2026-02-13T02:44:07.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.053+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc103e20 con 0x7f94dc0fe820 2026-02-13T02:44:07.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.053+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94dc1104d0 con 0x7f94dc0fe820 2026-02-13T02:44:07.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.055+0000 7f94ca7fc6c0 1 -- 10.20.193.78:0/2855403329 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f94d8003810 con 0x7f94dc0fe820 2026-02-13T02:44:07.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.057+0000 7f94ca7fc6c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b80b56d0 0x7f94b80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:07.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.057+0000 7f94ca7fc6c0 1 -- 10.20.193.78:0/2855403329 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f94d8108de0 con 0x7f94dc0fe820 2026-02-13T02:44:07.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.057+0000 7f94e12526c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b80b56d0 0x7f94b80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:07.058 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.057+0000 7f94ca7fc6c0 1 -- 10.20.193.78:0/2855403329 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f94d80cb700 con 0x7f94dc0fe820 2026-02-13T02:44:07.059 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.058+0000 7f94e12526c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b80b56d0 0x7f94b80d5b80 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94cc004750 tx=0x7f94cc009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:07.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.181+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f94dc10f5d0 con 0x7f94dc0fe820 2026-02-13T02:44:07.182 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.181+0000 7f94ca7fc6c0 1 -- 10.20.193.78:0/2855403329 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f94d80ce8b0 con 0x7f94dc0fe820 2026-02-13T02:44:07.182 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:07.182 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b80b56d0 msgr2=0x7f94b80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b80b56d0 0x7f94b80d5b80 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94cc004750 tx=0x7f94cc009260 comp rx=0 tx=0).stop 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc0fe820 msgr2=0x7f94dc0fecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc0fe820 0x7f94dc0fecc0 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94d800ab70 tx=0x7f94d80054b0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 shutdown_connections 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b80b56d0 0x7f94b80d5b80 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc0fe820 0x7f94dc0fecc0 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc115410 0x7f94dc175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 --2- 10.20.193.78:0/2855403329 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc10f200 0x7f94dc0fe2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 >> 10.20.193.78:0/2855403329 conn(0x7f94dc0ecb00 msgr2=0x7f94dc110c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.182+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 shutdown_connections 2026-02-13T02:44:07.184 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:07.183+0000 7f94e34e16c0 1 -- 10.20.193.78:0/2855403329 wait complete. 2026-02-13T02:44:07.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:06 trial091 ceph-mon[27614]: pgmap v252: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 10 op/s 2026-02-13T02:44:07.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:07 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2855403329' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:08.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:07 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2855403329' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:07 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2855403329' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:08.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:08 trial078 ceph-mon[22944]: pgmap v253: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:09.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:08 trial154 ceph-mon[27921]: pgmap v253: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:09.097 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:08 trial091 ceph-mon[27614]: pgmap v253: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:10.285 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:10.473 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:10.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 -- 10.20.193.78:0/1485684411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7314056d30 msgr2=0x7f7314057100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:10.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 --2- 10.20.193.78:0/1485684411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7314056d30 0x7f7314057100 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=871414855602163421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73040099a0 tx=0x7f730402ed00 comp rx=0 tx=0).stop 2026-02-13T02:44:10.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 -- 10.20.193.78:0/1485684411 shutdown_connections 2026-02-13T02:44:10.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 --2- 10.20.193.78:0/1485684411 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f731411bb90 0x7f731417c530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 --2- 10.20.193.78:0/1485684411 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7314057720 0x7f731411b3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.676 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 --2- 10.20.193.78:0/1485684411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7314056d30 0x7f7314057100 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=871414855602163421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 -- 10.20.193.78:0/1485684411 >> 10.20.193.78:0/1485684411 conn(0x7f731405cef0 msgr2=0x7f731405d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:10.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 -- 10.20.193.78:0/1485684411 shutdown_connections 2026-02-13T02:44:10.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.673+0000 7f731b8196c0 1 -- 10.20.193.78:0/1485684411 wait complete. 2026-02-13T02:44:10.677 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.674+0000 7f731b8196c0 1 Processor -- start 2026-02-13T02:44:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.674+0000 7f731b8196c0 1 -- start start 2026-02-13T02:44:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731b8196c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7314056d30 0x7f73140fd4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731b8196c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f731411bb90 0x7f731417c430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731b8196c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73140fdb00 0x7f7314102dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731b8196c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73140fe1f0 con 0x7f73140fdb00 2026-02-13T02:44:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731b8196c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7314103310 con 0x7f7314056d30 2026-02-13T02:44:10.679 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731b8196c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73141034d0 con 0x7f731411bb90 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f731411bb90 0x7f731417c430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f731411bb90 0x7f731417c430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:48832/0 (socket says 10.20.193.78:48832) 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 -- 10.20.193.78:0/544054825 learned_addr learned my addr 10.20.193.78:0/544054825 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7319d8b6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73140fdb00 0x7f7314102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731958a6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7314056d30 0x7f73140fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 -- 10.20.193.78:0/544054825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7314056d30 msgr2=0x7f73140fd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7314056d30 0x7f73140fd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 -- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73140fdb00 msgr2=0x7f7314102dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73140fdb00 0x7f7314102dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 -- 10.20.193.78:0/544054825 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7304009590 con 0x7f731411bb90 2026-02-13T02:44:10.680 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f731958a6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7314056d30 0x7f73140fd4d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:44:10.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.675+0000 7f7318d896c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f731411bb90 0x7f731417c430 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f730800b780 tx=0x7f730800bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:10.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.676+0000 7f73027fc6c0 1 -- 10.20.193.78:0/544054825 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7308004a80 con 0x7f731411bb90 2026-02-13T02:44:10.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.676+0000 7f73027fc6c0 1 -- 10.20.193.78:0/544054825 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7308009030 con 0x7f731411bb90 2026-02-13T02:44:10.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.676+0000 7f731b8196c0 1 -- 10.20.193.78:0/544054825 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73141037b0 con 0x7f731411bb90 2026-02-13T02:44:10.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.676+0000 7f73027fc6c0 1 -- 10.20.193.78:0/544054825 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f730800cd10 con 0x7f731411bb90 2026-02-13T02:44:10.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.676+0000 7f731b8196c0 1 -- 10.20.193.78:0/544054825 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7314103c40 con 0x7f731411bb90 2026-02-13T02:44:10.681 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.676+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7314116c50 con 0x7f731411bb90 2026-02-13T02:44:10.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.678+0000 7f73027fc6c0 1 -- 10.20.193.78:0/544054825 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7308005020 con 0x7f731411bb90 2026-02-13T02:44:10.682 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.680+0000 7f73027fc6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72f00b5650 0x7f72f00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:10.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.680+0000 7f73027fc6c0 1 -- 10.20.193.78:0/544054825 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f73080e39e0 con 0x7f731411bb90 2026-02-13T02:44:10.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.680+0000 7f731958a6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72f00b5650 0x7f72f00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:10.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.681+0000 7f73027fc6c0 1 -- 10.20.193.78:0/544054825 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f730811c5e0 con 0x7f731411bb90 2026-02-13T02:44:10.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.681+0000 7f731958a6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72f00b5650 0x7f72f00d5b00 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7304009970 tx=0x7f73040023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:10.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.805+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7314103c40 con 0x7f731411bb90 2026-02-13T02:44:10.807 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.805+0000 7f73027fc6c0 1 -- 10.20.193.78:0/544054825 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f73080a6340 con 0x7f731411bb90 2026-02-13T02:44:10.808 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:10.808 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:10.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72f00b5650 msgr2=0x7f72f00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:10.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72f00b5650 0x7f72f00d5b00 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7304009970 tx=0x7f73040023a0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f731411bb90 msgr2=0x7f731417c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:10.808 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f731411bb90 0x7f731417c430 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f730800b780 tx=0x7f730800bc50 comp rx=0 tx=0).stop 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 shutdown_connections 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f72f00b5650 0x7f72f00d5b00 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f73140fdb00 0x7f7314102dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f731411bb90 0x7f731417c430 unknown :-1 s=CLOSED pgs=128 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 --2- 10.20.193.78:0/544054825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7314056d30 0x7f73140fd4d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 >> 10.20.193.78:0/544054825 conn(0x7f731405cef0 msgr2=0x7f731405e330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 shutdown_connections 2026-02-13T02:44:10.809 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:10.807+0000 7f72e3fff6c0 1 -- 10.20.193.78:0/544054825 wait complete. 2026-02-13T02:44:10.853 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:10 trial078 ceph-mon[22944]: pgmap v254: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:11.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:10 trial154 ceph-mon[27921]: pgmap v254: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:11.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:10 trial091 ceph-mon[27614]: pgmap v254: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:11.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:11 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/544054825' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:12.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:11 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/544054825' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:12.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:11 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/544054825' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:12.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:12 trial078 ceph-mon[22944]: pgmap v255: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:13.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:12 trial154 ceph-mon[27921]: pgmap v255: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:13.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:12 trial091 ceph-mon[27614]: pgmap v255: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:13.913 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:14.097 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:14.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/3524844249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb4159ac0 msgr2=0x7f0fb4179ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:14.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/3524844249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb4159ac0 0x7f0fb4179ea0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=7954212149761882794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fb000aa40 tx=0x7f0fb002fdf0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/3524844249 shutdown_connections 2026-02-13T02:44:14.289 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/3524844249 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb4159ac0 0x7f0fb4179ea0 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=7954212149761882794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/3524844249 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fb4060ce0 0x7f0fb4061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/3524844249 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0fb40622d0 0x7f0fb40607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/3524844249 >> 10.20.193.78:0/3524844249 conn(0x7f0fb40ea880 msgr2=0x7f0fb410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/3524844249 shutdown_connections 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.287+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/3524844249 wait complete. 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 Processor -- start 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 -- start start 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fb4060ce0 0x7f0fb40f21f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb40622d0 0x7f0fb40f2730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0fb4159ac0 0x7f0fb40f7af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40f8140 con 0x7f0fb4060ce0 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40f82b0 con 0x7f0fb4159ac0 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.288+0000 7f0fbc1c96c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40f8470 con 0x7f0fb40622d0 2026-02-13T02:44:14.290 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb97396c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb40622d0 0x7f0fb40f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb97396c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb40622d0 0x7f0fb40f2730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:48848/0 (socket says 10.20.193.78:48848) 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb97396c0 1 -- 10.20.193.78:0/399730387 learned_addr learned my addr 10.20.193.78:0/399730387 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb9f3a6c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fb4060ce0 0x7f0fb40f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fba73b6c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0fb4159ac0 0x7f0fb40f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb9f3a6c0 1 -- 10.20.193.78:0/399730387 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb40622d0 msgr2=0x7f0fb40f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb9f3a6c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb40622d0 0x7f0fb40f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb9f3a6c0 1 -- 10.20.193.78:0/399730387 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0fb4159ac0 msgr2=0x7f0fb40f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb9f3a6c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0fb4159ac0 0x7f0fb40f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb9f3a6c0 1 -- 10.20.193.78:0/399730387 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb000a660 con 0x7f0fb4060ce0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fb9f3a6c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fb4060ce0 0x7f0fb40f21f0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fa400b6c0 tx=0x7f0fa400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fa2ffd6c0 1 -- 10.20.193.78:0/399730387 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fa4004240 con 0x7f0fb4060ce0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fa2ffd6c0 1 -- 10.20.193.78:0/399730387 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0fa4009030 con 0x7f0fb4060ce0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fa2ffd6c0 1 -- 10.20.193.78:0/399730387 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fa40036e0 con 0x7f0fb4060ce0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb40f8750 con 0x7f0fb4060ce0 2026-02-13T02:44:14.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.289+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb40f8e10 con 0x7f0fb4060ce0 2026-02-13T02:44:14.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.290+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb4061cb0 con 0x7f0fb4060ce0 2026-02-13T02:44:14.294 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.292+0000 7f0fa2ffd6c0 1 -- 10.20.193.78:0/399730387 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0fa40038a0 con 0x7f0fb4060ce0 2026-02-13T02:44:14.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.294+0000 7f0fa2ffd6c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f900b56d0 0x7f0f900d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:14.295 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.294+0000 7f0fa2ffd6c0 1 -- 10.20.193.78:0/399730387 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f0fa40e3a90 con 0x7f0fb4060ce0 2026-02-13T02:44:14.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.294+0000 7f0fa2ffd6c0 1 -- 10.20.193.78:0/399730387 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0fa411c5e0 con 0x7f0fb4060ce0 2026-02-13T02:44:14.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.294+0000 7f0fb97396c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f900b56d0 0x7f0f900d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:14.296 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.295+0000 7f0fb97396c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f900b56d0 0x7f0f900d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fb40f8b80 tx=0x7f0fa8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:14.424 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.422+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0fb40f3340 con 0x7f0fb4060ce0 2026-02-13T02:44:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.423+0000 7f0fa2ffd6c0 1 -- 10.20.193.78:0/399730387 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0fa40a63b0 con 0x7f0fb4060ce0 2026-02-13T02:44:14.425 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:14.425 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f900b56d0 msgr2=0x7f0f900d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:14.425 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f900b56d0 0x7f0f900d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fb40f8b80 tx=0x7f0fa8009260 comp rx=0 tx=0).stop 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fb4060ce0 msgr2=0x7f0fb40f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fb4060ce0 0x7f0fb40f21f0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fa400b6c0 tx=0x7f0fa400bb90 comp rx=0 tx=0).stop 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 shutdown_connections 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0f900b56d0 0x7f0f900d5b80 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0fb4159ac0 0x7f0fb40f7af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0fb40622d0 0x7f0fb40f2730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 --2- 10.20.193.78:0/399730387 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fb4060ce0 0x7f0fb40f21f0 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 >> 10.20.193.78:0/399730387 conn(0x7f0fb40ea880 msgr2=0x7f0fb410dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 shutdown_connections 2026-02-13T02:44:14.426 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:14.424+0000 7f0fbc1c96c0 1 -- 10.20.193.78:0/399730387 wait complete. 2026-02-13T02:44:14.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:14 trial078 ceph-mon[22944]: pgmap v256: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:14.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:14 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/399730387' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:15.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:14 trial154 ceph-mon[27921]: pgmap v256: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:15.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:14 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/399730387' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:15.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:14 trial091 ceph-mon[27614]: pgmap v256: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:15.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:14 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/399730387' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:16.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:16 trial078 ceph-mon[22944]: pgmap v257: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:17.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:16 trial154 ceph-mon[27921]: pgmap v257: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:17.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:16 trial091 ceph-mon[27614]: pgmap v257: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:17.526 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:17.712 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:17.909 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.908+0000 7f04c62a86c0 1 -- 10.20.193.78:0/562480457 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c010f200 msgr2=0x7f04c010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:17.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.908+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/562480457 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c010f200 0x7f04c010f5d0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=157481596306773222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac0099a0 tx=0x7f04ac02ed50 comp rx=0 tx=0).stop 2026-02-13T02:44:17.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 -- 10.20.193.78:0/562480457 shutdown_connections 2026-02-13T02:44:17.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/562480457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f04c0115410 0x7f04c0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:17.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/562480457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f04c010fbf0 0x7f04c0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:17.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/562480457 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c010f200 0x7f04c010f5d0 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=157481596306773222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:17.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 -- 10.20.193.78:0/562480457 >> 10.20.193.78:0/562480457 conn(0x7f04c00ecb00 msgr2=0x7f04c010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:17.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 -- 10.20.193.78:0/562480457 shutdown_connections 2026-02-13T02:44:17.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 -- 10.20.193.78:0/562480457 wait complete. 2026-02-13T02:44:17.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.909+0000 7f04c62a86c0 1 Processor -- start 2026-02-13T02:44:17.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c62a86c0 1 -- start start 2026-02-13T02:44:17.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c62a86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f04c010f200 0x7f04c011d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:17.911 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c62a86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c0115410 0x7f04c011d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c62a86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f04c0122ab0 0x7f04c0122f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c62a86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01234c0 con 0x7f04c0115410 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c62a86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0123630 con 0x7f04c0122ab0 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c62a86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04c01237f0 con 0x7f04c010f200 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c0115410 0x7f04c011d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c0115410 0x7f04c011d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:39926/0 (socket says 10.20.193.78:39926) 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 -- 10.20.193.78:0/3683971956 learned_addr learned my addr 10.20.193.78:0/3683971956 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:17.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bffff6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f04c010f200 0x7f04c011d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04c481e6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f04c0122ab0 0x7f04c0122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 -- 10.20.193.78:0/3683971956 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f04c010f200 msgr2=0x7f04c011d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f04c010f200 0x7f04c011d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 -- 10.20.193.78:0/3683971956 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f04c0122ab0 msgr2=0x7f04c0122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f04c0122ab0 0x7f04c0122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 -- 10.20.193.78:0/3683971956 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac009590 con 0x7f04c0115410 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.910+0000 7f04bf7fe6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c0115410 0x7f04c011d6f0 secure :-1 s=READY pgs=231 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04b000b800 tx=0x7f04b000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.911+0000 7f04bd7fa6c0 1 -- 10.20.193.78:0/3683971956 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04b0004a80 con 0x7f04c0115410 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.911+0000 7f04bd7fa6c0 1 -- 10.20.193.78:0/3683971956 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f04b0009070 con 0x7f04c0115410 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.911+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c0163ca0 con 0x7f04c0115410 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.911+0000 7f04bd7fa6c0 1 -- 10.20.193.78:0/3683971956 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04b000ce70 con 0x7f04c0115410 2026-02-13T02:44:17.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.911+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c0164130 con 0x7f04c0115410 2026-02-13T02:44:17.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.911+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c01104d0 con 0x7f04c0115410 2026-02-13T02:44:17.914 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.913+0000 7f04bd7fa6c0 1 -- 10.20.193.78:0/3683971956 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f04b0004060 con 0x7f04c0115410 2026-02-13T02:44:17.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.915+0000 7f04bd7fa6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04940b5650 0x7f04940d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:17.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.915+0000 7f04bd7fa6c0 1 -- 10.20.193.78:0/3683971956 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f04b00e3c70 con 0x7f04c0115410 2026-02-13T02:44:17.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.915+0000 7f04bffff6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04940b5650 0x7f04940d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:17.916 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.915+0000 7f04bd7fa6c0 1 -- 10.20.193.78:0/3683971956 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f04b00e40f0 con 0x7f04c0115410 2026-02-13T02:44:17.917 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:17.915+0000 7f04bffff6c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04940b5650 0x7f04940d5b00 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac005b40 tx=0x7f04ac0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:18.039 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.038+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f04c010f5d0 con 0x7f04c0115410 2026-02-13T02:44:18.040 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.038+0000 7f04bd7fa6c0 1 -- 10.20.193.78:0/3683971956 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f04b00a6590 con 0x7f04c0115410 2026-02-13T02:44:18.040 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:18.040 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04940b5650 msgr2=0x7f04940d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04940b5650 0x7f04940d5b00 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04ac005b40 tx=0x7f04ac0023a0 comp rx=0 tx=0).stop 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c0115410 msgr2=0x7f04c011d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c0115410 0x7f04c011d6f0 secure :-1 s=READY pgs=231 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04b000b800 tx=0x7f04b000bcd0 comp rx=0 tx=0).stop 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 shutdown_connections 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f04940b5650 0x7f04940d5b00 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f04c0122ab0 0x7f04c0122f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f04c0115410 0x7f04c011d6f0 unknown :-1 s=CLOSED pgs=231 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:18.041 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 --2- 10.20.193.78:0/3683971956 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f04c010f200 0x7f04c011d1b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:18.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 >> 10.20.193.78:0/3683971956 conn(0x7f04c00ecb00 msgr2=0x7f04c010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:18.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 shutdown_connections 2026-02-13T02:44:18.042 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:18.039+0000 7f04c62a86c0 1 -- 10.20.193.78:0/3683971956 wait complete. 2026-02-13T02:44:18.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:18 trial078 ceph-mon[22944]: pgmap v258: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:18.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:18 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3683971956' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:19.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:18 trial154 ceph-mon[27921]: pgmap v258: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:19.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:18 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3683971956' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:19.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:18 trial091 ceph-mon[27614]: pgmap v258: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:19.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:18 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3683971956' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:20.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:20 trial078 ceph-mon[22944]: pgmap v259: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:21.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:20 trial154 ceph-mon[27921]: pgmap v259: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:21.143 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:21.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:20 trial091 ceph-mon[27614]: pgmap v259: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:21.327 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:21.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 -- 10.20.193.78:0/3915145011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c114190 msgr2=0x7f008c115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:21.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 --2- 10.20.193.78:0/3915145011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c114190 0x7f008c115d40 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=16554361855419292998 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f007c0099a0 tx=0x7f007c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:44:21.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 -- 10.20.193.78:0/3915145011 shutdown_connections 2026-02-13T02:44:21.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 --2- 10.20.193.78:0/3915145011 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f008c116520 0x7f008c17a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.519 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 --2- 10.20.193.78:0/3915145011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c114190 0x7f008c115d40 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=16554361855419292998 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 --2- 10.20.193.78:0/3915145011 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f008c1137a0 0x7f008c113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 -- 10.20.193.78:0/3915145011 >> 10.20.193.78:0/3915145011 conn(0x7f008c061510 msgr2=0x7f008c061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:21.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 -- 10.20.193.78:0/3915145011 shutdown_connections 2026-02-13T02:44:21.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.517+0000 7f00914f76c0 1 -- 10.20.193.78:0/3915145011 wait complete. 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 Processor -- start 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 -- start start 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f008c1137a0 0x7f008c121560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c116520 0x7f008c121aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f008c126e60 0x7f008c127300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f008c127870 con 0x7f008c116520 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f008c1279e0 con 0x7f008c1137a0 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f00914f76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f008c127ba0 con 0x7f008c126e60 2026-02-13T02:44:21.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f008b7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c116520 0x7f008c121aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f008bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f008c1137a0 0x7f008c121560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f008b7fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c116520 0x7f008c121aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:39950/0 (socket says 10.20.193.78:39950) 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f008b7fe6c0 1 -- 10.20.193.78:0/3075388426 learned_addr learned my addr 10.20.193.78:0/3075388426 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.518+0000 7f0090cf66c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f008c126e60 0x7f008c127300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f008b7fe6c0 1 -- 10.20.193.78:0/3075388426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f008c126e60 msgr2=0x7f008c127300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f008b7fe6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f008c126e60 0x7f008c127300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f008b7fe6c0 1 -- 10.20.193.78:0/3075388426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f008c1137a0 msgr2=0x7f008c121560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f008b7fe6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f008c1137a0 0x7f008c121560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f008b7fe6c0 1 -- 10.20.193.78:0/3075388426 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c009590 con 0x7f008c116520 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f008bfff6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f008c1137a0 0x7f008c121560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:44:21.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f008b7fe6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c116520 0x7f008c121aa0 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f007c031f90 tx=0x7f007c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:21.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f00897fa6c0 1 -- 10.20.193.78:0/3075388426 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f007c002ae0 con 0x7f008c116520 2026-02-13T02:44:21.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f00897fa6c0 1 -- 10.20.193.78:0/3075388426 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f007c002c40 con 0x7f008c116520 2026-02-13T02:44:21.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f00897fa6c0 1 -- 10.20.193.78:0/3075388426 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f007c0312b0 con 0x7f008c116520 2026-02-13T02:44:21.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f00914f76c0 1 -- 10.20.193.78:0/3075388426 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008c167ff0 con 0x7f008c116520 2026-02-13T02:44:21.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.519+0000 7f00914f76c0 1 -- 10.20.193.78:0/3075388426 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008c168420 con 0x7f008c116520 2026-02-13T02:44:21.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.520+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c114840 con 0x7f008c116520 2026-02-13T02:44:21.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.522+0000 7f00897fa6c0 1 -- 10.20.193.78:0/3075388426 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f007c007260 con 0x7f008c116520 2026-02-13T02:44:21.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.523+0000 7f00897fa6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00600b57a0 0x7f00600d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:21.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.523+0000 7f00897fa6c0 1 -- 10.20.193.78:0/3075388426 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f007c107df0 con 0x7f008c116520 2026-02-13T02:44:21.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.524+0000 7f008bfff6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00600b57a0 0x7f00600d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:21.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.524+0000 7f00897fa6c0 1 -- 10.20.193.78:0/3075388426 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f007c108270 con 0x7f008c116520 2026-02-13T02:44:21.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.525+0000 7f008bfff6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00600b57a0 0x7f00600d5c50 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0078004750 tx=0x7f0078009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:21.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.648+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f008c113b70 con 0x7f008c116520 2026-02-13T02:44:21.650 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.648+0000 7f00897fa6c0 1 -- 10.20.193.78:0/3075388426 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f007c0ca710 con 0x7f008c116520 2026-02-13T02:44:21.650 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:21.650 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:21.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00600b57a0 msgr2=0x7f00600d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:21.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00600b57a0 0x7f00600d5c50 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0078004750 tx=0x7f0078009260 comp rx=0 tx=0).stop 2026-02-13T02:44:21.651 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c116520 msgr2=0x7f008c121aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c116520 0x7f008c121aa0 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f007c031f90 tx=0x7f007c0047f0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 shutdown_connections 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f00600b57a0 0x7f00600d5c50 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f008c126e60 0x7f008c127300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f008c116520 0x7f008c121aa0 unknown :-1 s=CLOSED pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 --2- 10.20.193.78:0/3075388426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f008c1137a0 0x7f008c121560 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 >> 10.20.193.78:0/3075388426 conn(0x7f008c061510 msgr2=0x7f008c114d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.649+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 shutdown_connections 2026-02-13T02:44:21.652 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:21.650+0000 7f005effd6c0 1 -- 10.20.193.78:0/3075388426 wait complete. 2026-02-13T02:44:21.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:21 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3075388426' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:22.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:21 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3075388426' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:22.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:21 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3075388426' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:22.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:22 trial078 ceph-mon[22944]: pgmap v260: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:23.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:22 trial154 ceph-mon[27921]: pgmap v260: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:23.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:22 trial091 ceph-mon[27614]: pgmap v260: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:24.757 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:24.943 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:24.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:24 trial078 ceph-mon[22944]: pgmap v261: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:25.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:24 trial154 ceph-mon[27921]: pgmap v261: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:25.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.148+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/4226734355 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda010f060 msgr2=0x7fdda010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:25.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.148+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/4226734355 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda010f060 0x7fdda010f430 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=16819929896185257170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd940099a0 tx=0x7fdd9402ed20 comp rx=0 tx=0).stop 2026-02-13T02:44:25.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.148+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/4226734355 shutdown_connections 2026-02-13T02:44:25.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.148+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/4226734355 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda0115270 0x7fdda0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.148+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/4226734355 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda010fa50 0x7fdda0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.148+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/4226734355 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda010f060 0x7fdda010f430 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=16819929896185257170 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.151 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.148+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/4226734355 >> 10.20.193.78:0/4226734355 conn(0x7fdda00ec980 msgr2=0x7fdda010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:25.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.149+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/4226734355 shutdown_connections 2026-02-13T02:44:25.152 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.149+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/4226734355 wait complete. 2026-02-13T02:44:25.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 Processor -- start 2026-02-13T02:44:25.153 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 -- start start 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda010f060 0x7fdda011cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda0115270 0x7fdda011d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda0122830 0x7fdda0122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0123240 con 0x7fdda0115270 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fdda01233b0 con 0x7fdda0122830 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9ffff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0123570 con 0x7fdda010f060 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9e7fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda0115270 0x7fdda011d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9e7fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda0115270 0x7fdda011d470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:39958/0 (socket says 10.20.193.78:39958) 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9e7fc6c0 1 -- 10.20.193.78:0/161763697 learned_addr learned my addr 10.20.193.78:0/161763697 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:25.154 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9f7fe6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda0122830 0x7fdda0122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.150+0000 7fdd9effd6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda010f060 0x7fdda011cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9e7fc6c0 1 -- 10.20.193.78:0/161763697 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda010f060 msgr2=0x7fdda011cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9e7fc6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda010f060 0x7fdda011cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9e7fc6c0 1 -- 10.20.193.78:0/161763697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda0122830 msgr2=0x7fdda0122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9e7fc6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda0122830 0x7fdda0122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9e7fc6c0 1 -- 10.20.193.78:0/161763697 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd94009590 con 0x7fdda0115270 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9e7fc6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda0115270 0x7fdda011d470 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd8800b800 tx=0x7fdd8800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd7ffff6c0 1 -- 10.20.193.78:0/161763697 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd88004a80 con 0x7fdda0115270 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd7ffff6c0 1 -- 10.20.193.78:0/161763697 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdd88009070 con 0x7fdda0115270 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd7ffff6c0 1 -- 10.20.193.78:0/161763697 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd8800cdb0 con 0x7fdda0115270 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda0163a20 con 0x7fdda0115270 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda0163eb0 con 0x7fdda0115270 2026-02-13T02:44:25.155 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.151+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda0110330 con 0x7fdda0115270 2026-02-13T02:44:25.157 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.154+0000 7fdd7ffff6c0 1 -- 10.20.193.78:0/161763697 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fdd88004070 con 0x7fdda0115270 2026-02-13T02:44:25.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.155+0000 7fdd7ffff6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd740b56d0 0x7fdd740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:25.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.155+0000 7fdd7ffff6c0 1 -- 10.20.193.78:0/161763697 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fdd880e3b80 con 0x7fdda0115270 2026-02-13T02:44:25.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.155+0000 7fdd7ffff6c0 1 -- 10.20.193.78:0/161763697 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdd8811c5e0 con 0x7fdda0115270 2026-02-13T02:44:25.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.155+0000 7fdd9effd6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd740b56d0 0x7fdd740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:25.158 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.156+0000 7fdd9effd6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd740b56d0 0x7fdd740d5b80 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd94005b40 tx=0x7fdd940023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:25.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:24 trial091 ceph-mon[27614]: pgmap v261: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:25.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.280+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdda010f430 con 0x7fdda0115270 2026-02-13T02:44:25.282 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.280+0000 7fdd7ffff6c0 1 -- 10.20.193.78:0/161763697 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdd880a64a0 con 0x7fdda0115270 2026-02-13T02:44:25.282 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:25.283 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.281+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd740b56d0 msgr2=0x7fdd740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.281+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd740b56d0 0x7fdd740d5b80 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd94005b40 tx=0x7fdd940023a0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.281+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda0115270 msgr2=0x7fdda011d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.281+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda0115270 0x7fdda011d470 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd8800b800 tx=0x7fdd8800bcd0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 shutdown_connections 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd740b56d0 0x7fdd740d5b80 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda0122830 0x7fdda0122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda0115270 0x7fdda011d470 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 --2- 10.20.193.78:0/161763697 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda010f060 0x7fdda011cf30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:25.284 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 >> 10.20.193.78:0/161763697 conn(0x7fdda00ec980 msgr2=0x7fdda010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:25.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 shutdown_connections 2026-02-13T02:44:25.285 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:25.282+0000 7fdd9ffff6c0 1 -- 10.20.193.78:0/161763697 wait complete. 2026-02-13T02:44:26.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:25 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/161763697' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:25 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/161763697' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:26.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:25 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/161763697' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:27.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:26 trial154 ceph-mon[27921]: pgmap v262: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:27.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:26 trial091 ceph-mon[27614]: pgmap v262: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:27.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:26 trial078 ceph-mon[22944]: pgmap v262: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:28.386 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:28.572 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 -- 10.20.193.78:0/797528361 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f572410f060 msgr2=0x7f572410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 --2- 10.20.193.78:0/797528361 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f572410f060 0x7f572410f430 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=12118687347118491081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57140099a0 tx=0x7f571402ed50 comp rx=0 tx=0).stop 2026-02-13T02:44:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 -- 10.20.193.78:0/797528361 shutdown_connections 2026-02-13T02:44:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 --2- 10.20.193.78:0/797528361 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5724115270 0x7f5724175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.769 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 --2- 10.20.193.78:0/797528361 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f572410fa50 0x7f5724114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 --2- 10.20.193.78:0/797528361 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f572410f060 0x7f572410f430 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=12118687347118491081 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 -- 10.20.193.78:0/797528361 >> 10.20.193.78:0/797528361 conn(0x7f57240ec980 msgr2=0x7f572410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 -- 10.20.193.78:0/797528361 shutdown_connections 2026-02-13T02:44:28.770 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.767+0000 7f572989b6c0 1 -- 10.20.193.78:0/797528361 wait complete. 2026-02-13T02:44:28.771 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 Processor -- start 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 -- start start 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572410f060 0x7f572411cf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5724115270 0x7f572411d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5724122890 0x7f5724122d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f57241232a0 con 0x7f5724115270 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5724123410 con 0x7f572410f060 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.768+0000 7f572989b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57241235d0 con 0x7f5724122890 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5724115270 0x7f572411d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5724115270 0x7f572411d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:54062/0 (socket says 10.20.193.78:54062) 2026-02-13T02:44:28.772 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 -- 10.20.193.78:0/752075807 learned_addr learned my addr 10.20.193.78:0/752075807 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f57288996c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572410f060 0x7f572411cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 -- 10.20.193.78:0/752075807 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5724122890 msgr2=0x7f5724122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5724122890 0x7f5724122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 -- 10.20.193.78:0/752075807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572410f060 msgr2=0x7f572411cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572410f060 0x7f572411cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 -- 10.20.193.78:0/752075807 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5714009590 con 0x7f5724115270 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f57288996c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572410f060 0x7f572411cf90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f571bfff6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5724115270 0x7f572411d4d0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f570c00b750 tx=0x7f570c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f5719ffb6c0 1 -- 10.20.193.78:0/752075807 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f570c004a80 con 0x7f5724115270 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f5719ffb6c0 1 -- 10.20.193.78:0/752075807 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f570c009030 con 0x7f5724115270 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f5719ffb6c0 1 -- 10.20.193.78:0/752075807 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f570c00cdd0 con 0x7f5724115270 2026-02-13T02:44:28.773 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5724163a80 con 0x7f5724115270 2026-02-13T02:44:28.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.769+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5724163f10 con 0x7f5724115270 2026-02-13T02:44:28.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.770+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5724110330 con 0x7f5724115270 2026-02-13T02:44:28.774 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.772+0000 7f5719ffb6c0 1 -- 10.20.193.78:0/752075807 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f570c0026b0 con 0x7f5724115270 2026-02-13T02:44:28.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.774+0000 7f5719ffb6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f57000b56d0 0x7f57000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:28.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.774+0000 7f5719ffb6c0 1 -- 10.20.193.78:0/752075807 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f570c0e3c00 con 0x7f5724115270 2026-02-13T02:44:28.775 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.774+0000 7f57288996c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f57000b56d0 0x7f57000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.774+0000 7f5719ffb6c0 1 -- 10.20.193.78:0/752075807 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f570c11c660 con 0x7f5724115270 2026-02-13T02:44:28.776 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.774+0000 7f57288996c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f57000b56d0 0x7f57000d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714009970 tx=0x7f57140023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:28.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.897+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f572411e110 con 0x7f5724115270 2026-02-13T02:44:28.899 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.897+0000 7f5719ffb6c0 1 -- 10.20.193.78:0/752075807 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f570c0a6520 con 0x7f5724115270 2026-02-13T02:44:28.899 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:28.900 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:28.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.898+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f57000b56d0 msgr2=0x7f57000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:28.900 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.898+0000 7f572989b6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f57000b56d0 0x7f57000d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714009970 tx=0x7f57140023a0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.898+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5724115270 msgr2=0x7f572411d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.898+0000 7f572989b6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5724115270 0x7f572411d4d0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f570c00b750 tx=0x7f570c00bc20 comp rx=0 tx=0).stop 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 shutdown_connections 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f57000b56d0 0x7f57000d5b80 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5724122890 0x7f5724122d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5724115270 0x7f572411d4d0 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 --2- 10.20.193.78:0/752075807 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572410f060 0x7f572411cf90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 >> 10.20.193.78:0/752075807 conn(0x7f57240ec980 msgr2=0x7f572410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 shutdown_connections 2026-02-13T02:44:28.901 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:28.899+0000 7f572989b6c0 1 -- 10.20.193.78:0/752075807 wait complete. 2026-02-13T02:44:28.959 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:28 trial078 ceph-mon[22944]: pgmap v263: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:29.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:28 trial154 ceph-mon[27921]: pgmap v263: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:29.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:28 trial091 ceph-mon[27614]: pgmap v263: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:30.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:29 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/752075807' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:30.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:29 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/752075807' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:30.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:29 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/752075807' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:31.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:30 trial154 ceph-mon[27921]: pgmap v264: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:31.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:30 trial091 ceph-mon[27614]: pgmap v264: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:31.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:30 trial078 ceph-mon[22944]: pgmap v264: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:32.001 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:32.186 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:32.389 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 -- 10.20.193.78:0/1792259707 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 msgr2=0x7f95c010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 --2- 10.20.193.78:0/1792259707 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 0x7f95c010f430 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=5230616801899431515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95ac0099a0 tx=0x7f95ac02ed00 comp rx=0 tx=0).stop 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 -- 10.20.193.78:0/1792259707 shutdown_connections 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 --2- 10.20.193.78:0/1792259707 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f95c0115270 0x7f95c0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 --2- 10.20.193.78:0/1792259707 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f95c010fa50 0x7f95c0114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 --2- 10.20.193.78:0/1792259707 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 0x7f95c010f430 unknown :-1 s=CLOSED pgs=130 gs=2 cs=0 l=1 c_cookie=5230616801899431515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 -- 10.20.193.78:0/1792259707 >> 10.20.193.78:0/1792259707 conn(0x7f95c00ec980 msgr2=0x7f95c010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 -- 10.20.193.78:0/1792259707 shutdown_connections 2026-02-13T02:44:32.390 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.388+0000 7f95c4f346c0 1 -- 10.20.193.78:0/1792259707 wait complete. 2026-02-13T02:44:32.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.389+0000 7f95c4f346c0 1 Processor -- start 2026-02-13T02:44:32.392 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.389+0000 7f95c4f346c0 1 -- start start 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.389+0000 7f95c4f346c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 0x7f95c011cf20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.389+0000 7f95c4f346c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f95c0115270 0x7f95c011d460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95c4f346c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f95c0122820 0x7f95c0122cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95c4f346c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0123230 con 0x7f95c0122820 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95c4f346c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01233a0 con 0x7f95c0115270 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95c4f346c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0123560 con 0x7f95c010f060 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bf7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 0x7f95c011cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bf7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 0x7f95c011cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:59850/0 (socket says 10.20.193.78:59850) 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bf7fe6c0 1 -- 10.20.193.78:0/3884492189 learned_addr learned my addr 10.20.193.78:0/3884492189 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95beffd6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f95c0115270 0x7f95c011d460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:32.393 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bffff6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f95c0122820 0x7f95c0122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95beffd6c0 1 -- 10.20.193.78:0/3884492189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 msgr2=0x7f95c011cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95beffd6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 0x7f95c011cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95beffd6c0 1 -- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f95c0122820 msgr2=0x7f95c0122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95beffd6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f95c0122820 0x7f95c0122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95beffd6c0 1 -- 10.20.193.78:0/3884492189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac009590 con 0x7f95c0115270 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bffff6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f95c0122820 0x7f95c0122cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95beffd6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f95c0115270 0x7f95c011d460 secure :-1 s=READY pgs=152 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95b0004750 tx=0x7f95b000bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bcff96c0 1 -- 10.20.193.78:0/3884492189 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95b0004a80 con 0x7f95c0115270 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bcff96c0 1 -- 10.20.193.78:0/3884492189 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f95b0009030 con 0x7f95c0115270 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95bcff96c0 1 -- 10.20.193.78:0/3884492189 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95b000cda0 con 0x7f95c0115270 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95c4f346c0 1 -- 10.20.193.78:0/3884492189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c0163a10 con 0x7f95c0115270 2026-02-13T02:44:32.394 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.390+0000 7f95c4f346c0 1 -- 10.20.193.78:0/3884492189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c0163ef0 con 0x7f95c0115270 2026-02-13T02:44:32.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.391+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c0110330 con 0x7f95c0115270 2026-02-13T02:44:32.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.393+0000 7f95bcff96c0 1 -- 10.20.193.78:0/3884492189 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f95b0004060 con 0x7f95c0115270 2026-02-13T02:44:32.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.395+0000 7f95bcff96c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f95940b56d0 0x7f95940d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:32.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.395+0000 7f95bcff96c0 1 -- 10.20.193.78:0/3884492189 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f95b00e3bf0 con 0x7f95c0115270 2026-02-13T02:44:32.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.395+0000 7f95bf7fe6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f95940b56d0 0x7f95940d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:32.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.395+0000 7f95bcff96c0 1 -- 10.20.193.78:0/3884492189 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f95b011c660 con 0x7f95c0115270 2026-02-13T02:44:32.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.395+0000 7f95bf7fe6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f95940b56d0 0x7f95940d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95ac0023e0 tx=0x7f95ac005b00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:32.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.519+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f95c011e070 con 0x7f95c0115270 2026-02-13T02:44:32.520 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.520+0000 7f95bcff96c0 1 -- 10.20.193.78:0/3884492189 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f95b00a6510 con 0x7f95c0115270 2026-02-13T02:44:32.521 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:32.521 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f95940b56d0 msgr2=0x7f95940d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f95940b56d0 0x7f95940d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95ac0023e0 tx=0x7f95ac005b00 comp rx=0 tx=0).stop 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f95c0115270 msgr2=0x7f95c011d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f95c0115270 0x7f95c011d460 secure :-1 s=READY pgs=152 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95b0004750 tx=0x7f95b000bb80 comp rx=0 tx=0).stop 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 shutdown_connections 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f95940b56d0 0x7f95940d5b80 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f95c0122820 0x7f95c0122cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.522 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f95c0115270 0x7f95c011d460 unknown :-1 s=CLOSED pgs=152 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 --2- 10.20.193.78:0/3884492189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f95c010f060 0x7f95c011cf20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:32.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 >> 10.20.193.78:0/3884492189 conn(0x7f95c00ec980 msgr2=0x7f95c010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:32.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 shutdown_connections 2026-02-13T02:44:32.523 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:32.521+0000 7f959a7fc6c0 1 -- 10.20.193.78:0/3884492189 wait complete. 2026-02-13T02:44:32.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:32 trial078 ceph-mon[22944]: pgmap v265: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:32.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:32 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3884492189' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:33.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:32 trial154 ceph-mon[27921]: pgmap v265: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:33.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:32 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3884492189' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:33.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:32 trial091 ceph-mon[27614]: pgmap v265: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:33.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:32 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3884492189' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:35.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:34 trial154 ceph-mon[27921]: pgmap v266: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:35.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:34 trial091 ceph-mon[27614]: pgmap v266: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:35.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:34 trial078 ceph-mon[22944]: pgmap v266: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:35.627 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:35.812 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:36.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 -- 10.20.193.78:0/4221457906 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff410fa50 msgr2=0x7f6ff4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:36.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 --2- 10.20.193.78:0/4221457906 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff410fa50 0x7f6ff4114a90 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=5576201108984167297 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fe40099a0 tx=0x7f6fe402ed00 comp rx=0 tx=0).stop 2026-02-13T02:44:36.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 -- 10.20.193.78:0/4221457906 shutdown_connections 2026-02-13T02:44:36.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 --2- 10.20.193.78:0/4221457906 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ff4115270 0x7f6ff4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 --2- 10.20.193.78:0/4221457906 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff410fa50 0x7f6ff4114a90 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=5576201108984167297 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 --2- 10.20.193.78:0/4221457906 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ff410f060 0x7f6ff410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 -- 10.20.193.78:0/4221457906 >> 10.20.193.78:0/4221457906 conn(0x7f6ff40ec980 msgr2=0x7f6ff410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:36.006 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.004+0000 7f6ff93ef6c0 1 -- 10.20.193.78:0/4221457906 shutdown_connections 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.005+0000 7f6ff93ef6c0 1 -- 10.20.193.78:0/4221457906 wait complete. 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 Processor -- start 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 -- start start 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ff410f060 0x7f6ff40f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ff4115270 0x7f6ff4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff40f4ff0 0x7f6ff40fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff40f56e0 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.008 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff40fa7b0 con 0x7f6ff410f060 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff93ef6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff40fa970 con 0x7f6ff4115270 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff8bee6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff40f4ff0 0x7f6ff40fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff8bee6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff40f4ff0 0x7f6ff40fa270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:54104/0 (socket says 10.20.193.78:54104) 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.006+0000 7f6ff8bee6c0 1 -- 10.20.193.78:0/944618309 learned_addr learned my addr 10.20.193.78:0/944618309 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff37fe6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ff4115270 0x7f6ff4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff3fff6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ff410f060 0x7f6ff40f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff8bee6c0 1 -- 10.20.193.78:0/944618309 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ff4115270 msgr2=0x7f6ff4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff8bee6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ff4115270 0x7f6ff4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff8bee6c0 1 -- 10.20.193.78:0/944618309 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ff410f060 msgr2=0x7f6ff40f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff8bee6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ff410f060 0x7f6ff40f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.009 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff8bee6c0 1 -- 10.20.193.78:0/944618309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe4009590 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff8bee6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff40f4ff0 0x7f6ff40fa270 secure :-1 s=READY pgs=239 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fe8006ea0 tx=0x7f6fe800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff17fa6c0 1 -- 10.20.193.78:0/944618309 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fe8003c40 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff17fa6c0 1 -- 10.20.193.78:0/944618309 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6fe8003da0 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff17fa6c0 1 -- 10.20.193.78:0/944618309 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fe80081c0 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff93ef6c0 1 -- 10.20.193.78:0/944618309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff40fac50 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.007+0000 7f6ff93ef6c0 1 -- 10.20.193.78:0/944618309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff40fb0e0 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.010 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.008+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff4110330 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.011 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.010+0000 7f6ff17fa6c0 1 -- 10.20.193.78:0/944618309 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6fe800d590 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.012 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.012+0000 7f6ff17fa6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6fc80b5650 0x7f6fc80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:36.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.012+0000 7f6ff17fa6c0 1 -- 10.20.193.78:0/944618309 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f6fe80e4ac0 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.012+0000 7f6ff3fff6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6fc80b5650 0x7f6fc80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:36.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.012+0000 7f6ff17fa6c0 1 -- 10.20.193.78:0/944618309 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6fe811d5e0 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.013 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.012+0000 7f6ff3fff6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6fc80b5650 0x7f6fc80d5b00 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fe0004750 tx=0x7f6fe0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:36.138 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.137+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ff40fb0e0 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.139 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.138+0000 7f6ff17fa6c0 1 -- 10.20.193.78:0/944618309 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6fe80a7420 con 0x7f6ff40f4ff0 2026-02-13T02:44:36.139 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:36.140 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:36.140 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6fc80b5650 msgr2=0x7f6fc80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6fc80b5650 0x7f6fc80d5b00 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fe0004750 tx=0x7f6fe0009260 comp rx=0 tx=0).stop 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff40f4ff0 msgr2=0x7f6ff40fa270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff40f4ff0 0x7f6ff40fa270 secure :-1 s=READY pgs=239 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fe8006ea0 tx=0x7f6fe800ce50 comp rx=0 tx=0).stop 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 shutdown_connections 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6fc80b5650 0x7f6fc80d5b00 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ff40f4ff0 0x7f6ff40fa270 unknown :-1 s=CLOSED pgs=239 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6ff4115270 0x7f6ff4175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 --2- 10.20.193.78:0/944618309 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6ff410f060 0x7f6ff40f49c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 >> 10.20.193.78:0/944618309 conn(0x7f6ff40ec980 msgr2=0x7f6ff410d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:36.141 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 shutdown_connections 2026-02-13T02:44:36.142 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:36.139+0000 7f6fc6ffd6c0 1 -- 10.20.193.78:0/944618309 wait complete. 2026-02-13T02:44:37.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:36 trial154 ceph-mon[27921]: pgmap v267: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:37.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:36 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/944618309' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:36 trial091 ceph-mon[27614]: pgmap v267: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:37.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:36 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/944618309' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:37.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:36 trial078 ceph-mon[22944]: pgmap v267: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:37.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:36 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/944618309' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:39.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:38 trial154 ceph-mon[27921]: pgmap v268: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:39.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:38 trial091 ceph-mon[27614]: pgmap v268: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:39.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:38 trial078 ceph-mon[22944]: pgmap v268: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:39.246 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:39.432 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:39.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 -- 10.20.193.78:0/2002758559 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c110ef0 msgr2=0x7f2c4c111370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/2002758559 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c110ef0 0x7f2c4c111370 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=8186138861484379902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4800aa40 tx=0x7f2c4802fde0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 -- 10.20.193.78:0/2002758559 shutdown_connections 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/2002758559 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c110ef0 0x7f2c4c111370 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=8186138861484379902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/2002758559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c4c10c2d0 0x7f2c4c1108a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/2002758559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c4c10b8e0 0x7f2c4c10bcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 -- 10.20.193.78:0/2002758559 >> 10.20.193.78:0/2002758559 conn(0x7f2c4c0e9570 msgr2=0x7f2c4c109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 -- 10.20.193.78:0/2002758559 shutdown_connections 2026-02-13T02:44:39.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.632+0000 7f2c52f686c0 1 -- 10.20.193.78:0/2002758559 wait complete. 2026-02-13T02:44:39.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 Processor -- start 2026-02-13T02:44:39.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 -- start start 2026-02-13T02:44:39.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c10b8e0 0x7f2c4c1217f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:39.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c4c10c2d0 0x7f2c4c121d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:39.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c4c110ef0 0x7f2c4c1270f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c127740 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c1278b0 con 0x7f2c4c110ef0 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c52f686c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c127a70 con 0x7f2c4c10c2d0 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c51f666c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c10b8e0 0x7f2c4c1217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c51f666c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c10b8e0 0x7f2c4c1217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:55628/0 (socket says 10.20.193.78:55628) 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c51f666c0 1 -- 10.20.193.78:0/1446504089 learned_addr learned my addr 10.20.193.78:0/1446504089 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c517656c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c4c10c2d0 0x7f2c4c121d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.633+0000 7f2c527676c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c4c110ef0 0x7f2c4c1270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c51f666c0 1 -- 10.20.193.78:0/1446504089 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c4c10c2d0 msgr2=0x7f2c4c121d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:39.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c51f666c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c4c10c2d0 0x7f2c4c121d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c51f666c0 1 -- 10.20.193.78:0/1446504089 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c4c110ef0 msgr2=0x7f2c4c1270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c51f666c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c4c110ef0 0x7f2c4c1270f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c51f666c0 1 -- 10.20.193.78:0/1446504089 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4800a660 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c51f666c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c10b8e0 0x7f2c4c1217f0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3c00b710 tx=0x7f2c3c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c3affd6c0 1 -- 10.20.193.78:0/1446504089 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c3c004250 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c3affd6c0 1 -- 10.20.193.78:0/1446504089 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2c3c009070 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c3affd6c0 1 -- 10.20.193.78:0/1446504089 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c3c00cd70 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c127d50 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c168430 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.634+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c127f70 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.638+0000 7f2c3affd6c0 1 -- 10.20.193.78:0/1446504089 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2c3c0028c0 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.639+0000 7f2c3affd6c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c280b56d0 0x7f2c280d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:39.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.639+0000 7f2c3affd6c0 1 -- 10.20.193.78:0/1446504089 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f2c3c0e3bd0 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.639+0000 7f2c517656c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c280b56d0 0x7f2c280d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:39.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.639+0000 7f2c3affd6c0 1 -- 10.20.193.78:0/1446504089 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c3c11c660 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.640+0000 7f2c517656c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c280b56d0 0x7f2c280d5b80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c40005980 tx=0x7f2c40005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:39.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.763+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c4c05fb90 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.763+0000 7f2c3affd6c0 1 -- 10.20.193.78:0/1446504089 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2c3c0a64f0 con 0x7f2c4c10b8e0 2026-02-13T02:44:39.765 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:39.766 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c280b56d0 msgr2=0x7f2c280d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c280b56d0 0x7f2c280d5b80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c40005980 tx=0x7f2c40005910 comp rx=0 tx=0).stop 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c10b8e0 msgr2=0x7f2c4c1217f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c10b8e0 0x7f2c4c1217f0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3c00b710 tx=0x7f2c3c00bbe0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 shutdown_connections 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f2c280b56d0 0x7f2c280d5b80 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c4c110ef0 0x7f2c4c1270f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c4c10c2d0 0x7f2c4c121d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 --2- 10.20.193.78:0/1446504089 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2c4c10b8e0 0x7f2c4c1217f0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:39.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 >> 10.20.193.78:0/1446504089 conn(0x7f2c4c0e9570 msgr2=0x7f2c4c109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:39.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.764+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 shutdown_connections 2026-02-13T02:44:39.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:39.765+0000 7f2c52f686c0 1 -- 10.20.193.78:0/1446504089 wait complete. 2026-02-13T02:44:41.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:40 trial154 ceph-mon[27921]: pgmap v269: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:41.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:40 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1446504089' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:41.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:40 trial091 ceph-mon[27614]: pgmap v269: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:41.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:40 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1446504089' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:40 trial078 ceph-mon[22944]: pgmap v269: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:41.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:40 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1446504089' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:42.869 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:43.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:42 trial154 ceph-mon[27921]: pgmap v270: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:43.055 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:43.099 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:42 trial078 ceph-mon[22944]: pgmap v270: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:43.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:42 trial091 ceph-mon[27614]: pgmap v270: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:43.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 -- 10.20.193.78:0/702426254 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 msgr2=0x7f074411b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/702426254 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 0x7f074411b8e0 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=3001052129379500515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0738009970 tx=0x7f073802ed10 comp rx=0 tx=0).stop 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 -- 10.20.193.78:0/702426254 shutdown_connections 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/702426254 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f07441149c0 0x7f0744114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/702426254 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0744113dc0 0x7f0744114210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/702426254 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 0x7f074411b8e0 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=3001052129379500515 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 -- 10.20.193.78:0/702426254 >> 10.20.193.78:0/702426254 conn(0x7f0744058a50 msgr2=0x7f0744058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.248+0000 7f0748aa56c0 1 -- 10.20.193.78:0/702426254 shutdown_connections 2026-02-13T02:44:43.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.249+0000 7f0748aa56c0 1 -- 10.20.193.78:0/702426254 wait complete. 2026-02-13T02:44:43.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.249+0000 7f0748aa56c0 1 Processor -- start 2026-02-13T02:44:43.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.249+0000 7f0748aa56c0 1 -- start start 2026-02-13T02:44:43.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.249+0000 7f0748aa56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0744113dc0 0x7f074412b860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:43.253 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.249+0000 7f0748aa56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f07441149c0 0x7f074412bda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0748aa56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 0x7f0744131160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0748aa56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f07441317b0 con 0x7f07441149c0 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0748aa56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0744131920 con 0x7f0744113dc0 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0748aa56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0744131ae0 con 0x7f074411b510 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f07425756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0744113dc0 0x7f074412b860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f07425756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0744113dc0 0x7f074412b860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:48074/0 (socket says 10.20.193.78:48074) 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f07425756c0 1 -- 10.20.193.78:0/368234065 learned_addr learned my addr 10.20.193.78:0/368234065 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0741d746c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f07441149c0 0x7f074412bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0742d766c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 0x7f0744131160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0741d746c0 1 -- 10.20.193.78:0/368234065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 msgr2=0x7f0744131160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:43.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0741d746c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 0x7f0744131160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0741d746c0 1 -- 10.20.193.78:0/368234065 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0744113dc0 msgr2=0x7f074412b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0741d746c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0744113dc0 0x7f074412b860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0741d746c0 1 -- 10.20.193.78:0/368234065 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073400a5b0 con 0x7f07441149c0 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0741d746c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f07441149c0 0x7f074412bda0 secure :-1 s=READY pgs=242 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f072c00b6e0 tx=0x7f072c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f072b7fe6c0 1 -- 10.20.193.78:0/368234065 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f072c004a80 con 0x7f07441149c0 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f072b7fe6c0 1 -- 10.20.193.78:0/368234065 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f072c009030 con 0x7f07441149c0 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f072b7fe6c0 1 -- 10.20.193.78:0/368234065 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f072c00cd40 con 0x7f07441149c0 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0738009590 con 0x7f07441149c0 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.250+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07441722f0 con 0x7f07441149c0 2026-02-13T02:44:43.255 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.251+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074405b000 con 0x7f07441149c0 2026-02-13T02:44:43.256 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.253+0000 7f072b7fe6c0 1 -- 10.20.193.78:0/368234065 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f072c004060 con 0x7f07441149c0 2026-02-13T02:44:43.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.255+0000 7f072b7fe6c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f071c0b56d0 0x7f071c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:43.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.255+0000 7f072b7fe6c0 1 -- 10.20.193.78:0/368234065 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f072c0e3b60 con 0x7f07441149c0 2026-02-13T02:44:43.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.255+0000 7f07425756c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f071c0b56d0 0x7f071c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:43.257 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.255+0000 7f072b7fe6c0 1 -- 10.20.193.78:0/368234065 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f072c11c5e0 con 0x7f07441149c0 2026-02-13T02:44:43.258 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.256+0000 7f07425756c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f071c0b56d0 0x7f071c0d5b80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0738031fd0 tx=0x7f0738005e20 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:43.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.379+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0744114ee0 con 0x7f07441149c0 2026-02-13T02:44:43.381 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.380+0000 7f072b7fe6c0 1 -- 10.20.193.78:0/368234065 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f072c0a6480 con 0x7f07441149c0 2026-02-13T02:44:43.382 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:43.382 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:43.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f071c0b56d0 msgr2=0x7f071c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:43.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f071c0b56d0 0x7f071c0d5b80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0738031fd0 tx=0x7f0738005e20 comp rx=0 tx=0).stop 2026-02-13T02:44:43.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f07441149c0 msgr2=0x7f074412bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:43.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f07441149c0 0x7f074412bda0 secure :-1 s=READY pgs=242 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f072c00b6e0 tx=0x7f072c00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 shutdown_connections 2026-02-13T02:44:43.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f071c0b56d0 0x7f071c0d5b80 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.383 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f074411b510 0x7f0744131160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f07441149c0 0x7f074412bda0 unknown :-1 s=CLOSED pgs=242 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 --2- 10.20.193.78:0/368234065 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0744113dc0 0x7f074412b860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:43.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 >> 10.20.193.78:0/368234065 conn(0x7f0744058a50 msgr2=0x7f074411a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:43.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 shutdown_connections 2026-02-13T02:44:43.384 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:43.381+0000 7f0748aa56c0 1 -- 10.20.193.78:0/368234065 wait complete. 2026-02-13T02:44:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:43 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/368234065' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:43 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/368234065' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:43 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/368234065' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:44.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:44 trial091 ceph-mon[27614]: pgmap v271: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:45.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:44 trial154 ceph-mon[27921]: pgmap v271: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:45.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:44 trial078 ceph-mon[22944]: pgmap v271: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:46.486 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:46.672 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:46.804 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:46 trial078 ceph-mon[22944]: pgmap v272: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.870+0000 7f0a1c4586c0 1 -- 10.20.193.78:0/4075769744 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a1410fbf0 msgr2=0x7f0a14114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.870+0000 7f0a1c4586c0 1 --2- 10.20.193.78:0/4075769744 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a1410fbf0 0x7f0a14114c30 secure :-1 s=READY pgs=132 gs=2 cs=0 l=1 c_cookie=3504508031738277036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a080099a0 tx=0x7f0a0802ed00 comp rx=0 tx=0).stop 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.870+0000 7f0a1c4586c0 1 -- 10.20.193.78:0/4075769744 shutdown_connections 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.870+0000 7f0a1c4586c0 1 --2- 10.20.193.78:0/4075769744 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 0x7f0a14175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.870+0000 7f0a1c4586c0 1 --2- 10.20.193.78:0/4075769744 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a1410fbf0 0x7f0a14114c30 unknown :-1 s=CLOSED pgs=132 gs=2 cs=0 l=1 c_cookie=3504508031738277036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.870+0000 7f0a1c4586c0 1 --2- 10.20.193.78:0/4075769744 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a1410f200 0x7f0a1410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.870+0000 7f0a1c4586c0 1 -- 10.20.193.78:0/4075769744 >> 10.20.193.78:0/4075769744 conn(0x7f0a140ecb00 msgr2=0x7f0a1410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.871+0000 7f0a1c4586c0 1 -- 10.20.193.78:0/4075769744 shutdown_connections 2026-02-13T02:44:46.873 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.871+0000 7f0a1c4586c0 1 -- 10.20.193.78:0/4075769744 wait complete. 2026-02-13T02:44:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.871+0000 7f0a1c4586c0 1 Processor -- start 2026-02-13T02:44:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.871+0000 7f0a1c4586c0 1 -- start start 2026-02-13T02:44:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1c4586c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a1410f200 0x7f0a140f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:46.875 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1c4586c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 0x7f0a14175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1c4586c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a140f5140 0x7f0a140fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1c4586c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140f5830 con 0x7f0a1410f200 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1c4586c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140fa950 con 0x7f0a14115410 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1c4586c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a140fab10 con 0x7f0a140f5140 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 0x7f0a14175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 0x7f0a14175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:40586/0 (socket says 10.20.193.78:40586) 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 -- 10.20.193.78:0/1819940006 learned_addr learned my addr 10.20.193.78:0/1819940006 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1a1c96c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a1410f200 0x7f0a140f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1a9ca6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a140f5140 0x7f0a140fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 -- 10.20.193.78:0/1819940006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a140f5140 msgr2=0x7f0a140fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:46.876 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a140f5140 0x7f0a140fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 -- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a1410f200 msgr2=0x7f0a140f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a1410f200 0x7f0a140f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 -- 10.20.193.78:0/1819940006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a08009590 con 0x7f0a14115410 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a1a1c96c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a1410f200 0x7f0a140f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.872+0000 7f0a199c86c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 0x7f0a14175cb0 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a08009290 tx=0x7f0a0802fce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.873+0000 7f09fb7fe6c0 1 -- 10.20.193.78:0/1819940006 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a08002ae0 con 0x7f0a14115410 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.873+0000 7f09fb7fe6c0 1 -- 10.20.193.78:0/1819940006 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0a080046b0 con 0x7f0a14115410 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.873+0000 7f0a1c4586c0 1 -- 10.20.193.78:0/1819940006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a140fad90 con 0x7f0a14115410 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.873+0000 7f0a1c4586c0 1 -- 10.20.193.78:0/1819940006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a140fb210 con 0x7f0a14115410 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.873+0000 7f09fb7fe6c0 1 -- 10.20.193.78:0/1819940006 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a08031250 con 0x7f0a14115410 2026-02-13T02:44:46.877 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.873+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a141104d0 con 0x7f0a14115410 2026-02-13T02:44:46.878 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.875+0000 7f09fb7fe6c0 1 -- 10.20.193.78:0/1819940006 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0a08002c40 con 0x7f0a14115410 2026-02-13T02:44:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.877+0000 7f09fb7fe6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09f00b5650 0x7f09f00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.877+0000 7f09fb7fe6c0 1 -- 10.20.193.78:0/1819940006 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f0a08107b50 con 0x7f0a14115410 2026-02-13T02:44:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.877+0000 7f0a1a1c96c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09f00b5650 0x7f09f00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.877+0000 7f09fb7fe6c0 1 -- 10.20.193.78:0/1819940006 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0a081405e0 con 0x7f0a14115410 2026-02-13T02:44:46.879 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:46.878+0000 7f0a1a1c96c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09f00b5650 0x7f09f00d5b00 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a04004750 tx=0x7f0a04009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:47.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.000+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0a1410f5d0 con 0x7f0a14115410 2026-02-13T02:44:47.002 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.001+0000 7f09fb7fe6c0 1 -- 10.20.193.78:0/1819940006 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0a080ca470 con 0x7f0a14115410 2026-02-13T02:44:47.003 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:47.003 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09f00b5650 msgr2=0x7f09f00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09f00b5650 0x7f09f00d5b00 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a04004750 tx=0x7f0a04009260 comp rx=0 tx=0).stop 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 msgr2=0x7f0a14175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 0x7f0a14175cb0 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a08009290 tx=0x7f0a0802fce0 comp rx=0 tx=0).stop 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 shutdown_connections 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09f00b5650 0x7f09f00d5b00 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a140f5140 0x7f0a140fa410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a14115410 0x7f0a14175cb0 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 --2- 10.20.193.78:0/1819940006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a1410f200 0x7f0a140f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 >> 10.20.193.78:0/1819940006 conn(0x7f0a140ecb00 msgr2=0x7f0a14113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:47.004 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 shutdown_connections 2026-02-13T02:44:47.005 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:47.002+0000 7f09f97fa6c0 1 -- 10.20.193.78:0/1819940006 wait complete. 2026-02-13T02:44:47.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:46 trial154 ceph-mon[27921]: pgmap v272: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:47.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:46 trial091 ceph-mon[27614]: pgmap v272: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:48.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:47 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1819940006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:48.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:47 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1819940006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:48.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:47 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1819940006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:48 trial154 ceph-mon[27921]: pgmap v273: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:49.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:48 trial091 ceph-mon[27614]: pgmap v273: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:49.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:48 trial078 ceph-mon[22944]: pgmap v273: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:50.112 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:50.298 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:50.496 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/1486151364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb410fbf0 msgr2=0x7fbcb4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/1486151364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb410fbf0 0x7fbcb4114c30 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=5895170519528032301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca80099a0 tx=0x7fbca802ed20 comp rx=0 tx=0).stop 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/1486151364 shutdown_connections 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/1486151364 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb4115410 0x7fbcb4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/1486151364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb410fbf0 0x7fbcb4114c30 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=5895170519528032301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/1486151364 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb410f200 0x7fbcb410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/1486151364 >> 10.20.193.78:0/1486151364 conn(0x7fbcb40ecb00 msgr2=0x7fbcb410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/1486151364 shutdown_connections 2026-02-13T02:44:50.497 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.494+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/1486151364 wait complete. 2026-02-13T02:44:50.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.495+0000 7fbcbbed86c0 1 Processor -- start 2026-02-13T02:44:50.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.495+0000 7fbcbbed86c0 1 -- start start 2026-02-13T02:44:50.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcbbed86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb410f200 0x7fbcb40f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:50.499 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcbbed86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4115410 0x7fbcb4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcbbed86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb40f5280 0x7fbcb40fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcbbed86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40f5970 con 0x7fbcb4115410 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcbbed86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40faa90 con 0x7fbcb410f200 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcbbed86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb40fac50 con 0x7fbcb40f5280 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4115410 0x7fbcb4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4115410 0x7fbcb4175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34690/0 (socket says 10.20.193.78:34690) 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 -- 10.20.193.78:0/82730297 learned_addr learned my addr 10.20.193.78:0/82730297 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb9c4d6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb410f200 0x7fbcb40f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcba44e6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb40f5280 0x7fbcb40fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 -- 10.20.193.78:0/82730297 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb40f5280 msgr2=0x7fbcb40fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:50.500 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb40f5280 0x7fbcb40fa550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 -- 10.20.193.78:0/82730297 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb410f200 msgr2=0x7fbcb40f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb410f200 0x7fbcb40f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 -- 10.20.193.78:0/82730297 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca8009590 con 0x7fbcb4115410 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.496+0000 7fbcb944c6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4115410 0x7fbcb4175cb0 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca8031f90 tx=0x7fbca80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.497+0000 7fbca2ffd6c0 1 -- 10.20.193.78:0/82730297 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbca8002ae0 con 0x7fbcb4115410 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.497+0000 7fbca2ffd6c0 1 -- 10.20.193.78:0/82730297 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbca8002c40 con 0x7fbcb4115410 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.497+0000 7fbca2ffd6c0 1 -- 10.20.193.78:0/82730297 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbca80312b0 con 0x7fbcb4115410 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.497+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb40faed0 con 0x7fbcb4115410 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.497+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb40fb300 con 0x7fbcb4115410 2026-02-13T02:44:50.501 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.497+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb41104d0 con 0x7fbcb4115410 2026-02-13T02:44:50.502 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.499+0000 7fbca2ffd6c0 1 -- 10.20.193.78:0/82730297 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbca8007260 con 0x7fbcb4115410 2026-02-13T02:44:50.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.501+0000 7fbca2ffd6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b56d0 0x7fbc900d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:50.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.501+0000 7fbca2ffd6c0 1 -- 10.20.193.78:0/82730297 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fbca8107db0 con 0x7fbcb4115410 2026-02-13T02:44:50.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.501+0000 7fbcb9c4d6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b56d0 0x7fbc900d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:50.503 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.501+0000 7fbca2ffd6c0 1 -- 10.20.193.78:0/82730297 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbca8108230 con 0x7fbcb4115410 2026-02-13T02:44:50.504 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.502+0000 7fbcb9c4d6c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b56d0 0x7fbc900d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca4005980 tx=0x7fbca4005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:50.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.625+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbcb410f5d0 con 0x7fbcb4115410 2026-02-13T02:44:50.627 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.625+0000 7fbca2ffd6c0 1 -- 10.20.193.78:0/82730297 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbca80ca6d0 con 0x7fbcb4115410 2026-02-13T02:44:50.628 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:50.628 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b56d0 msgr2=0x7fbc900d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b56d0 0x7fbc900d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca4005980 tx=0x7fbca4005910 comp rx=0 tx=0).stop 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4115410 msgr2=0x7fbcb4175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4115410 0x7fbcb4175cb0 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbca8031f90 tx=0x7fbca80047f0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 shutdown_connections 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbc900b56d0 0x7fbc900d5b80 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcb40f5280 0x7fbcb40fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbcb4115410 0x7fbcb4175cb0 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 --2- 10.20.193.78:0/82730297 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcb410f200 0x7fbcb40f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:50.629 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 >> 10.20.193.78:0/82730297 conn(0x7fbcb40ecb00 msgr2=0x7fbcb410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:50.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 shutdown_connections 2026-02-13T02:44:50.630 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:50.627+0000 7fbcbbed86c0 1 -- 10.20.193.78:0/82730297 wait complete. 2026-02-13T02:44:50.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:50 trial078 ceph-mon[22944]: pgmap v274: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:50.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:50 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/82730297' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:50 trial154 ceph-mon[27921]: pgmap v274: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:50 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/82730297' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:51.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:50 trial091 ceph-mon[27614]: pgmap v274: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:44:51.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:50 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/82730297' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:53.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:52 trial091 ceph-mon[27614]: pgmap v275: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:53.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:52 trial078 ceph-mon[22944]: pgmap v275: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:53.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:52 trial154 ceph-mon[27921]: pgmap v275: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:53.734 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:53.921 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:54.112 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/899121197 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb7410ba90 msgr2=0x7fbb7410be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/899121197 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb7410ba90 0x7fbb7410be60 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=6540709080576860964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb64009970 tx=0x7fbb6402ed10 comp rx=0 tx=0).stop 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/899121197 shutdown_connections 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/899121197 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbb741110a0 0x7fbb74111520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/899121197 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbb7410c480 0x7fbb74110a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/899121197 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb7410ba90 0x7fbb7410be60 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=6540709080576860964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/899121197 >> 10.20.193.78:0/899121197 conn(0x7fbb740e9700 msgr2=0x7fbb74109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/899121197 shutdown_connections 2026-02-13T02:44:54.113 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.111+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/899121197 wait complete. 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 Processor -- start 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 -- start start 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbb7410ba90 0x7fbb741219e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbb7410c480 0x7fbb74121f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb741110a0 0x7fbb741272e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbb74127930 con 0x7fbb741110a0 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbb74127aa0 con 0x7fbb7410ba90 2026-02-13T02:44:54.114 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb7b6f76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbb74127c60 con 0x7fbb7410c480 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.112+0000 7fbb79c696c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb741110a0 0x7fbb741272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb741110a0 0x7fbb741272e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:34706/0 (socket says 10.20.193.78:34706) 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 -- 10.20.193.78:0/2619442208 learned_addr learned my addr 10.20.193.78:0/2619442208 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb794686c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbb7410ba90 0x7fbb741219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb78c676c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbb7410c480 0x7fbb74121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 -- 10.20.193.78:0/2619442208 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbb7410c480 msgr2=0x7fbb74121f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbb7410c480 0x7fbb74121f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 -- 10.20.193.78:0/2619442208 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbb7410ba90 msgr2=0x7fbb741219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:54.115 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbb7410ba90 0x7fbb741219e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 -- 10.20.193.78:0/2619442208 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb64009590 con 0x7fbb741110a0 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb79c696c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb741110a0 0x7fbb741272e0 secure :-1 s=READY pgs=246 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb70006ea0 tx=0x7fbb7000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb627fc6c0 1 -- 10.20.193.78:0/2619442208 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb70003a30 con 0x7fbb741110a0 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb74127f40 con 0x7fbb741110a0 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb74168620 con 0x7fbb741110a0 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb627fc6c0 1 -- 10.20.193.78:0/2619442208 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fbb70005510 con 0x7fbb741110a0 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.113+0000 7fbb627fc6c0 1 -- 10.20.193.78:0/2619442208 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb7000dd70 con 0x7fbb741110a0 2026-02-13T02:44:54.116 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.114+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7405fb90 con 0x7fbb741110a0 2026-02-13T02:44:54.117 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.116+0000 7fbb627fc6c0 1 -- 10.20.193.78:0/2619442208 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbb70003b90 con 0x7fbb741110a0 2026-02-13T02:44:54.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.117+0000 7fbb627fc6c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbb500b56d0 0x7fbb500d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:54.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.118+0000 7fbb627fc6c0 1 -- 10.20.193.78:0/2619442208 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fbb700e4c50 con 0x7fbb741110a0 2026-02-13T02:44:54.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.118+0000 7fbb794686c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbb500b56d0 0x7fbb500d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:54.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.118+0000 7fbb627fc6c0 1 -- 10.20.193.78:0/2619442208 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbb700e50d0 con 0x7fbb741110a0 2026-02-13T02:44:54.120 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.118+0000 7fbb794686c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbb500b56d0 0x7fbb500d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb640098c0 tx=0x7fbb640023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:54.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.241+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb74122b30 con 0x7fbb741110a0 2026-02-13T02:44:54.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.241+0000 7fbb627fc6c0 1 -- 10.20.193.78:0/2619442208 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbb700a7570 con 0x7fbb741110a0 2026-02-13T02:44:54.243 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:54.243 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:54.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.242+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbb500b56d0 msgr2=0x7fbb500d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:54.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.242+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbb500b56d0 0x7fbb500d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb640098c0 tx=0x7fbb640023a0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb741110a0 msgr2=0x7fbb741272e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:54.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb741110a0 0x7fbb741272e0 secure :-1 s=READY pgs=246 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb70006ea0 tx=0x7fbb7000cca0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 shutdown_connections 2026-02-13T02:44:54.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fbb500b56d0 0x7fbb500d5b80 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fbb741110a0 0x7fbb741272e0 unknown :-1 s=CLOSED pgs=246 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbb7410c480 0x7fbb74121f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 --2- 10.20.193.78:0/2619442208 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbb7410ba90 0x7fbb741219e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:54.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 >> 10.20.193.78:0/2619442208 conn(0x7fbb740e9700 msgr2=0x7fbb74109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:54.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 shutdown_connections 2026-02-13T02:44:54.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:54.243+0000 7fbb7b6f76c0 1 -- 10.20.193.78:0/2619442208 wait complete. 2026-02-13T02:44:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:54 trial091 ceph-mon[27614]: pgmap v276: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:54.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:54 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2619442208' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:55.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:54 trial078 ceph-mon[22944]: pgmap v276: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:55.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:54 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2619442208' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:55.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:54 trial154 ceph-mon[27921]: pgmap v276: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:44:55.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:54 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2619442208' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:56.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:55 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:44:56.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:55 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:44:56.233 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:55 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:44:57.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:56 trial091 ceph-mon[27614]: pgmap v277: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:57.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:44:57.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:44:57.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:44:57.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:44:57.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:44:57.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:44:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:56 trial078 ceph-mon[22944]: pgmap v277: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:44:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:44:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:44:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:44:57.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:44:57.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:44:57.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:56 trial154 ceph-mon[27921]: pgmap v277: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:44:57.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:44:57.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:44:57.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:44:57.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:44:57.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:44:57.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:44:57.351 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:44:57.536 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/4172367479 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa41554f0 msgr2=0x7f0aa41758d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/4172367479 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa41554f0 0x7f0aa41758d0 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=13677085256901942955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa000aa40 tx=0x7f0aa002fde0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/4172367479 shutdown_connections 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/4172367479 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa41554f0 0x7f0aa41758d0 unknown :-1 s=CLOSED pgs=133 gs=2 cs=0 l=1 c_cookie=13677085256901942955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/4172367479 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0aa4061050 0x7f0aa4154fb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/4172367479 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0aa4060740 0x7f0aa4060b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/4172367479 >> 10.20.193.78:0/4172367479 conn(0x7f0aa40ea6a0 msgr2=0x7f0aa410aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/4172367479 shutdown_connections 2026-02-13T02:44:57.736 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.733+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/4172367479 wait complete. 2026-02-13T02:44:57.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 Processor -- start 2026-02-13T02:44:57.737 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 -- start start 2026-02-13T02:44:57.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa4060740 0x7f0aa41611f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:57.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0aa4061050 0x7f0aa4161730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:57.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0aa41554f0 0x7f0aa4166af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:57.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4167140 con 0x7f0aa41554f0 2026-02-13T02:44:57.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa41672b0 con 0x7f0aa4061050 2026-02-13T02:44:57.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa9e1b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4167470 con 0x7f0aa4060740 2026-02-13T02:44:57.738 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa8e196c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa4060740 0x7f0aa41611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0a9bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0aa4061050 0x7f0aa4161730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0a9bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0aa4061050 0x7f0aa4161730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:48096/0 (socket says 10.20.193.78:48096) 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0a9bfff6c0 1 -- 10.20.193.78:0/2713771684 learned_addr learned my addr 10.20.193.78:0/2713771684 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.734+0000 7f0aa961a6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0aa41554f0 0x7f0aa4166af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa961a6c0 1 -- 10.20.193.78:0/2713771684 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa4060740 msgr2=0x7f0aa41611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa961a6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa4060740 0x7f0aa41611f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa961a6c0 1 -- 10.20.193.78:0/2713771684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0aa4061050 msgr2=0x7f0aa4161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa961a6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0aa4061050 0x7f0aa4161730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa961a6c0 1 -- 10.20.193.78:0/2713771684 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a940094c0 con 0x7f0aa41554f0 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa961a6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0aa41554f0 0x7f0aa4166af0 secure :-1 s=READY pgs=247 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4055f10 tx=0x7f0aa00054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:57.739 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0a99ffb6c0 1 -- 10.20.193.78:0/2713771684 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa0003a30 con 0x7f0aa41554f0 2026-02-13T02:44:57.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0a99ffb6c0 1 -- 10.20.193.78:0/2713771684 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0aa0030990 con 0x7f0aa41554f0 2026-02-13T02:44:57.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0a99ffb6c0 1 -- 10.20.193.78:0/2713771684 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0aa0038070 con 0x7f0aa41554f0 2026-02-13T02:44:57.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa000a660 con 0x7f0aa41554f0 2026-02-13T02:44:57.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.735+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa4150f70 con 0x7f0aa41554f0 2026-02-13T02:44:57.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.736+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa4167990 con 0x7f0aa41554f0 2026-02-13T02:44:57.740 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.738+0000 7f0a99ffb6c0 1 -- 10.20.193.78:0/2713771684 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0aa0003b90 con 0x7f0aa41554f0 2026-02-13T02:44:57.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.739+0000 7f0a99ffb6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0a800b56d0 0x7f0a800d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:44:57.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.739+0000 7f0a99ffb6c0 1 -- 10.20.193.78:0/2713771684 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f0aa0108c40 con 0x7f0aa41554f0 2026-02-13T02:44:57.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.740+0000 7f0aa8e196c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0a800b56d0 0x7f0a800d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:44:57.741 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.740+0000 7f0a99ffb6c0 1 -- 10.20.193.78:0/2713771684 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0aa01090c0 con 0x7f0aa41554f0 2026-02-13T02:44:57.742 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.740+0000 7f0aa8e196c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0a800b56d0 0x7f0a800d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a94004750 tx=0x7f0a94009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:44:57.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.864+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0aa4061c50 con 0x7f0aa41554f0 2026-02-13T02:44:57.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.864+0000 7f0a99ffb6c0 1 -- 10.20.193.78:0/2713771684 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0aa00cb560 con 0x7f0aa41554f0 2026-02-13T02:44:57.866 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:44:57.866 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:44:57.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0a800b56d0 msgr2=0x7f0a800d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:57.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0a800b56d0 0x7f0a800d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a94004750 tx=0x7f0a94009260 comp rx=0 tx=0).stop 2026-02-13T02:44:57.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0aa41554f0 msgr2=0x7f0aa4166af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:44:57.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0aa41554f0 0x7f0aa4166af0 secure :-1 s=READY pgs=247 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa4055f10 tx=0x7f0aa00054b0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 shutdown_connections 2026-02-13T02:44:57.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f0a800b56d0 0x7f0a800d5b80 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0aa41554f0 0x7f0aa4166af0 unknown :-1 s=CLOSED pgs=247 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0aa4061050 0x7f0aa4161730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 --2- 10.20.193.78:0/2713771684 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0aa4060740 0x7f0aa41611f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:44:57.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 >> 10.20.193.78:0/2713771684 conn(0x7f0aa40ea6a0 msgr2=0x7f0aa410aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:44:57.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 shutdown_connections 2026-02-13T02:44:57.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:44:57.866+0000 7f0aa9e1b6c0 1 -- 10.20.193.78:0/2713771684 wait complete. 2026-02-13T02:44:57.928 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:57 trial078 ceph-mon[22944]: pgmap v278: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:57.928 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:57 trial078 ceph-mon[22944]: pgmap v279: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T02:44:58.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:57 trial091 ceph-mon[27614]: pgmap v278: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:58.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:57 trial091 ceph-mon[27614]: pgmap v279: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T02:44:58.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:57 trial154 ceph-mon[27921]: pgmap v278: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:44:58.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:57 trial154 ceph-mon[27921]: pgmap v279: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T02:44:59.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:58 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2713771684' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:59.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:58 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2713771684' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:44:59.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:58 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2713771684' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:44:59 trial091 ceph-mon[27614]: pgmap v280: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:44:59 trial078 ceph-mon[22944]: pgmap v280: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:00.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:44:59 trial154 ceph-mon[27921]: pgmap v280: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:00.971 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:01.158 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/327282301 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0114190 msgr2=0x7fe1b0115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/327282301 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0114190 0x7fe1b0115d40 secure :-1 s=READY pgs=134 gs=3 cs=0 l=1 c_cookie=15837834007551424669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a40099a0 tx=0x7fe1a402ed00 comp rx=0 tx=0).stop 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/327282301 shutdown_connections 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/327282301 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b0116520 0x7fe1b017a100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/327282301 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0114190 0x7fe1b0115d40 unknown :-1 s=CLOSED pgs=134 gs=3 cs=0 l=1 c_cookie=15837834007551424669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/327282301 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1b01137a0 0x7fe1b0113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/327282301 >> 10.20.193.78:0/327282301 conn(0x7fe1b0061510 msgr2=0x7fe1b0061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/327282301 shutdown_connections 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.355+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/327282301 wait complete. 2026-02-13T02:45:01.357 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 Processor -- start 2026-02-13T02:45:01.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 -- start start 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b01137a0 0x7fe1b0121500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1b0116520 0x7fe1b0121a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0126e00 0x7fe1b01272a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0127810 con 0x7fe1b01137a0 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0127980 con 0x7fe1b0116520 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b67de6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0127b40 con 0x7fe1b0126e00 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b57dc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b01137a0 0x7fe1b0121500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b4fdb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1b0116520 0x7fe1b0121a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b57dc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b01137a0 0x7fe1b0121500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:53556/0 (socket says 10.20.193.78:53556) 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b57dc6c0 1 -- 10.20.193.78:0/3074539338 learned_addr learned my addr 10.20.193.78:0/3074539338 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:01.359 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b5fdd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0126e00 0x7fe1b01272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.356+0000 7fe1b4fdb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1b0116520 0x7fe1b0121a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:48124/0 (socket says 10.20.193.78:48124) 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b57dc6c0 1 -- 10.20.193.78:0/3074539338 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0126e00 msgr2=0x7fe1b01272a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b57dc6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0126e00 0x7fe1b01272a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b57dc6c0 1 -- 10.20.193.78:0/3074539338 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1b0116520 msgr2=0x7fe1b0121a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b57dc6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1b0116520 0x7fe1b0121a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b57dc6c0 1 -- 10.20.193.78:0/3074539338 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a00094c0 con 0x7fe1b01137a0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b57dc6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b01137a0 0x7fe1b0121500 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a000ba30 tx=0x7fe1a000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe19e7fc6c0 1 -- 10.20.193.78:0/3074539338 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1a00044a0 con 0x7fe1b01137a0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe19e7fc6c0 1 -- 10.20.193.78:0/3074539338 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe1a0009030 con 0x7fe1b01137a0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a4009590 con 0x7fe1b01137a0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b0168340 con 0x7fe1b01137a0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.357+0000 7fe19e7fc6c0 1 -- 10.20.193.78:0/3074539338 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1a00071c0 con 0x7fe1b01137a0 2026-02-13T02:45:01.360 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.358+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b0114840 con 0x7fe1b01137a0 2026-02-13T02:45:01.362 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.360+0000 7fe19e7fc6c0 1 -- 10.20.193.78:0/3074539338 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe1a00026b0 con 0x7fe1b01137a0 2026-02-13T02:45:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.361+0000 7fe19e7fc6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe18c0b56d0 0x7fe18c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:01.363 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.362+0000 7fe19e7fc6c0 1 -- 10.20.193.78:0/3074539338 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fe1a00e3c70 con 0x7fe1b01137a0 2026-02-13T02:45:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.362+0000 7fe19e7fc6c0 1 -- 10.20.193.78:0/3074539338 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe1a00e40f0 con 0x7fe1b01137a0 2026-02-13T02:45:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.362+0000 7fe1b4fdb6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe18c0b56d0 0x7fe18c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:01.364 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.362+0000 7fe1b4fdb6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe18c0b56d0 0x7fe18c0d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1b0127e90 tx=0x7fe1a40023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:01.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.485+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe1b0113b70 con 0x7fe1b01137a0 2026-02-13T02:45:01.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.485+0000 7fe19e7fc6c0 1 -- 10.20.193.78:0/3074539338 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe1a00a6590 con 0x7fe1b01137a0 2026-02-13T02:45:01.488 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:01.488 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe18c0b56d0 msgr2=0x7fe18c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe18c0b56d0 0x7fe18c0d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1b0127e90 tx=0x7fe1a40023a0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b01137a0 msgr2=0x7fe1b0121500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b01137a0 0x7fe1b0121500 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a000ba30 tx=0x7fe1a000bf00 comp rx=0 tx=0).stop 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 shutdown_connections 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe18c0b56d0 0x7fe18c0d5b80 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1b0126e00 0x7fe1b01272a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1b0116520 0x7fe1b0121a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 --2- 10.20.193.78:0/3074539338 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe1b01137a0 0x7fe1b0121500 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:01.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 >> 10.20.193.78:0/3074539338 conn(0x7fe1b0061510 msgr2=0x7fe1b0114d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:01.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 shutdown_connections 2026-02-13T02:45:01.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:01.487+0000 7fe1b67de6c0 1 -- 10.20.193.78:0/3074539338 wait complete. 2026-02-13T02:45:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:01 trial078 ceph-mon[22944]: pgmap v281: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:01 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3074539338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:02.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:01 trial091 ceph-mon[27614]: pgmap v281: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:02.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:01 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3074539338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:02.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:01 trial154 ceph-mon[27921]: pgmap v281: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:02.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:01 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3074539338' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:04.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:03 trial091 ceph-mon[27614]: pgmap v282: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:04.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:03 trial078 ceph-mon[22944]: pgmap v282: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:04.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:03 trial154 ceph-mon[27921]: pgmap v282: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:45:04.594 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:04.780 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 -- 10.20.193.78:0/2941816682 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff29410f060 msgr2=0x7ff29410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 --2- 10.20.193.78:0/2941816682 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff29410f060 0x7ff29410f430 secure :-1 s=READY pgs=154 gs=1 cs=0 l=1 c_cookie=7627687572776338409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff288009970 tx=0x7ff28802ed50 comp rx=0 tx=0).stop 2026-02-13T02:45:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 -- 10.20.193.78:0/2941816682 shutdown_connections 2026-02-13T02:45:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 --2- 10.20.193.78:0/2941816682 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff294115270 0x7ff294175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 --2- 10.20.193.78:0/2941816682 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff29410fa50 0x7ff294114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:04.990 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 --2- 10.20.193.78:0/2941816682 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff29410f060 0x7ff29410f430 unknown :-1 s=CLOSED pgs=154 gs=1 cs=0 l=1 c_cookie=7627687572776338409 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 -- 10.20.193.78:0/2941816682 >> 10.20.193.78:0/2941816682 conn(0x7ff2940ec980 msgr2=0x7ff29410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 -- 10.20.193.78:0/2941816682 shutdown_connections 2026-02-13T02:45:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.987+0000 7ff293fff6c0 1 -- 10.20.193.78:0/2941816682 wait complete. 2026-02-13T02:45:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 Processor -- start 2026-02-13T02:45:04.991 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 -- start start 2026-02-13T02:45:04.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff29410f060 0x7ff29411cfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:04.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff294115270 0x7ff29411d500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff2941228c0 0x7ff294122d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff2941232d0 con 0x7ff29410f060 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff294123440 con 0x7ff294115270 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.988+0000 7ff293fff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff294123600 con 0x7ff2941228c0 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff29410f060 0x7ff29411cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff29410f060 0x7ff29411cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:53574/0 (socket says 10.20.193.78:53574) 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 -- 10.20.193.78:0/1662302112 learned_addr learned my addr 10.20.193.78:0/1662302112 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff2937fe6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff2941228c0 0x7ff294122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff2927fc6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff294115270 0x7ff29411d500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 -- 10.20.193.78:0/1662302112 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff2941228c0 msgr2=0x7ff294122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff2941228c0 0x7ff294122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:04.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 -- 10.20.193.78:0/1662302112 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff294115270 msgr2=0x7ff29411d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff294115270 0x7ff29411d500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 -- 10.20.193.78:0/1662302112 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff288009590 con 0x7ff29410f060 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff2937fe6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff2941228c0 0x7ff294122d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff292ffd6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff29410f060 0x7ff29411cfc0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2880092b0 tx=0x7ff28802fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff273fff6c0 1 -- 10.20.193.78:0/1662302112 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff288002ae0 con 0x7ff29410f060 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff273fff6c0 1 -- 10.20.193.78:0/1662302112 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff288002c40 con 0x7ff29410f060 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff273fff6c0 1 -- 10.20.193.78:0/1662302112 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2880372f0 con 0x7ff29410f060 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff293fff6c0 1 -- 10.20.193.78:0/1662302112 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff294163a50 con 0x7ff29410f060 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.989+0000 7ff293fff6c0 1 -- 10.20.193.78:0/1662302112 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff294163e80 con 0x7ff29410f060 2026-02-13T02:45:04.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.990+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c005310 con 0x7ff29410f060 2026-02-13T02:45:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.992+0000 7ff273fff6c0 1 -- 10.20.193.78:0/1662302112 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff288007260 con 0x7ff29410f060 2026-02-13T02:45:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.994+0000 7ff273fff6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff2680b56d0 0x7ff2680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:04.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.994+0000 7ff273fff6c0 1 -- 10.20.193.78:0/1662302112 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7ff288107f10 con 0x7ff29410f060 2026-02-13T02:45:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.994+0000 7ff273fff6c0 1 -- 10.20.193.78:0/1662302112 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff288108390 con 0x7ff29410f060 2026-02-13T02:45:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.994+0000 7ff2927fc6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff2680b56d0 0x7ff2680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:04.996 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:04.994+0000 7ff2927fc6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff2680b56d0 0x7ff2680d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff294123950 tx=0x7ff27c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.117+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff25c005960 con 0x7ff29410f060 2026-02-13T02:45:05.119 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.117+0000 7ff273fff6c0 1 -- 10.20.193.78:0/1662302112 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff2880ca830 con 0x7ff29410f060 2026-02-13T02:45:05.120 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:05.120 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff2680b56d0 msgr2=0x7ff2680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff2680b56d0 0x7ff2680d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff294123950 tx=0x7ff27c009260 comp rx=0 tx=0).stop 2026-02-13T02:45:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff29410f060 msgr2=0x7ff29411cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff29410f060 0x7ff29411cfc0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2880092b0 tx=0x7ff28802fca0 comp rx=0 tx=0).stop 2026-02-13T02:45:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 shutdown_connections 2026-02-13T02:45:05.121 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7ff2680b56d0 0x7ff2680d5b80 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff2941228c0 0x7ff294122d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff294115270 0x7ff29411d500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 --2- 10.20.193.78:0/1662302112 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff29410f060 0x7ff29411cfc0 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 >> 10.20.193.78:0/1662302112 conn(0x7ff2940ec980 msgr2=0x7ff29410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 shutdown_connections 2026-02-13T02:45:05.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:05.119+0000 7ff271ffb6c0 1 -- 10.20.193.78:0/1662302112 wait complete. 2026-02-13T02:45:06.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:05 trial091 ceph-mon[27614]: pgmap v283: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T02:45:06.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:05 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1662302112' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:05 trial078 ceph-mon[22944]: pgmap v283: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T02:45:06.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:05 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1662302112' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:06.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:05 trial154 ceph-mon[27921]: pgmap v283: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T02:45:06.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:05 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1662302112' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:08.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:07 trial091 ceph-mon[27614]: pgmap v284: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T02:45:08.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:07 trial078 ceph-mon[22944]: pgmap v284: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T02:45:08.258 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:08.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:07 trial154 ceph-mon[27921]: pgmap v284: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T02:45:08.444 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:08.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/9205251 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f40115410 msgr2=0x7f1f40175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:08.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/9205251 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f40115410 0x7f1f40175db0 secure :-1 s=READY pgs=250 gs=3 cs=0 l=1 c_cookie=829502404940974500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f3c00a9b0 tx=0x7f1f3c02fd60 comp rx=0 tx=0).stop 2026-02-13T02:45:08.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/9205251 shutdown_connections 2026-02-13T02:45:08.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/9205251 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f40115410 0x7f1f40175db0 unknown :-1 s=CLOSED pgs=250 gs=3 cs=0 l=1 c_cookie=829502404940974500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/9205251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f4010fbf0 0x7f1f40114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/9205251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f4010f200 0x7f1f4010f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/9205251 >> 10.20.193.78:0/9205251 conn(0x7f1f400ecb00 msgr2=0x7f1f4010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:08.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/9205251 shutdown_connections 2026-02-13T02:45:08.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.632+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/9205251 wait complete. 2026-02-13T02:45:08.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 Processor -- start 2026-02-13T02:45:08.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 -- start start 2026-02-13T02:45:08.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f4010f200 0x7f1f4011d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:08.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f40115410 0x7f1f4011d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f40122a70 0x7f1f40122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1f40123480 con 0x7f1f4010f200 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1f401235f0 con 0x7f1f40115410 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.633+0000 7f1f4822c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f401237b0 con 0x7f1f40122a70 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f4010f200 0x7f1f4011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f457a06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f40115410 0x7f1f4011d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f4010f200 0x7f1f4011d170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:43622/0 (socket says 10.20.193.78:43622) 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 -- 10.20.193.78:0/196898336 learned_addr learned my addr 10.20.193.78:0/196898336 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f467a26c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f40122a70 0x7f1f40122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 -- 10.20.193.78:0/196898336 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f40122a70 msgr2=0x7f1f40122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:08.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f40122a70 0x7f1f40122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 -- 10.20.193.78:0/196898336 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f40115410 msgr2=0x7f1f4011d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f40115410 0x7f1f4011d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 -- 10.20.193.78:0/196898336 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f30009590 con 0x7f1f4010f200 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f457a06c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f40115410 0x7f1f4011d6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f45fa16c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f4010f200 0x7f1f4011d170 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f30004750 tx=0x7f1f3000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f2effd6c0 1 -- 10.20.193.78:0/196898336 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f300044a0 con 0x7f1f4010f200 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f2effd6c0 1 -- 10.20.193.78:0/196898336 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1f30009030 con 0x7f1f4010f200 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f2effd6c0 1 -- 10.20.193.78:0/196898336 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f300071c0 con 0x7f1f4010f200 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c00a5b0 con 0x7f1f4010f200 2026-02-13T02:45:08.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.634+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f40163fb0 con 0x7f1f4010f200 2026-02-13T02:45:08.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.635+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f401104d0 con 0x7f1f4010f200 2026-02-13T02:45:08.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.637+0000 7f1f2effd6c0 1 -- 10.20.193.78:0/196898336 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1f300026b0 con 0x7f1f4010f200 2026-02-13T02:45:08.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.639+0000 7f1f2effd6c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1f1c0b56d0 0x7f1f1c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:08.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.639+0000 7f1f2effd6c0 1 -- 10.20.193.78:0/196898336 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f1f300e3d10 con 0x7f1f4010f200 2026-02-13T02:45:08.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.639+0000 7f1f457a06c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1f1c0b56d0 0x7f1f1c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:08.641 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.639+0000 7f1f2effd6c0 1 -- 10.20.193.78:0/196898336 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1f300e4200 con 0x7f1f4010f200 2026-02-13T02:45:08.642 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.640+0000 7f1f457a06c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1f1c0b56d0 0x7f1f1c0d5b80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f40123b00 tx=0x7f1f34009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:08.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.763+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f4010f5d0 con 0x7f1f4010f200 2026-02-13T02:45:08.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.763+0000 7f1f2effd6c0 1 -- 10.20.193.78:0/196898336 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1f300a6670 con 0x7f1f4010f200 2026-02-13T02:45:08.766 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:08.766 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:08.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1f1c0b56d0 msgr2=0x7f1f1c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:08.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1f1c0b56d0 0x7f1f1c0d5b80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f40123b00 tx=0x7f1f34009260 comp rx=0 tx=0).stop 2026-02-13T02:45:08.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f4010f200 msgr2=0x7f1f4011d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:08.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f4010f200 0x7f1f4011d170 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f30004750 tx=0x7f1f3000be00 comp rx=0 tx=0).stop 2026-02-13T02:45:08.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 shutdown_connections 2026-02-13T02:45:08.767 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f1f1c0b56d0 0x7f1f1c0d5b80 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f40122a70 0x7f1f40122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f40115410 0x7f1f4011d6b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 --2- 10.20.193.78:0/196898336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f4010f200 0x7f1f4011d170 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:08.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.764+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 >> 10.20.193.78:0/196898336 conn(0x7f1f400ecb00 msgr2=0x7f1f4010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:08.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.765+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 shutdown_connections 2026-02-13T02:45:08.768 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:08.765+0000 7f1f4822c6c0 1 -- 10.20.193.78:0/196898336 wait complete. 2026-02-13T02:45:08.824 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/196898336' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/196898336' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:09.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/196898336' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:10.096 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:09 trial091 ceph-mon[27614]: pgmap v285: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:10.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:09 trial078 ceph-mon[22944]: pgmap v285: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:10.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:09 trial154 ceph-mon[27921]: pgmap v285: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:11.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:10 trial154 ceph-mon[27921]: pgmap v286: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:11.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:10 trial091 ceph-mon[27614]: pgmap v286: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:11.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:10 trial078 ceph-mon[22944]: pgmap v286: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:11.867 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:12.052 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:12.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4082565941 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc410f060 msgr2=0x7f9fc410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:12.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4082565941 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc410f060 0x7f9fc410f430 secure :-1 s=READY pgs=155 gs=2 cs=0 l=1 c_cookie=14816697956554976972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb8009970 tx=0x7f9fb802ed10 comp rx=0 tx=0).stop 2026-02-13T02:45:12.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4082565941 shutdown_connections 2026-02-13T02:45:12.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4082565941 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fc4115270 0x7f9fc4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4082565941 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410fa50 0x7f9fc4114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4082565941 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc410f060 0x7f9fc410f430 unknown :-1 s=CLOSED pgs=155 gs=2 cs=0 l=1 c_cookie=14816697956554976972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4082565941 >> 10.20.193.78:0/4082565941 conn(0x7f9fc40ec980 msgr2=0x7f9fc410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:12.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4082565941 shutdown_connections 2026-02-13T02:45:12.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.243+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4082565941 wait complete. 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 Processor -- start 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 -- start start 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410f060 0x7f9fc411cf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc4115270 0x7f9fc411d490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fc4122850 0x7f9fc4122cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4123260 con 0x7f9fc410f060 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41233d0 con 0x7f9fc4115270 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.244+0000 7f9fc3fff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4123590 con 0x7f9fc4122850 2026-02-13T02:45:12.248 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410f060 0x7f9fc411cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410f060 0x7f9fc411cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:43632/0 (socket says 10.20.193.78:43632) 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 -- 10.20.193.78:0/4075267230 learned_addr learned my addr 10.20.193.78:0/4075267230 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc27fc6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc4115270 0x7f9fc411d490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc37fe6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fc4122850 0x7f9fc4122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 -- 10.20.193.78:0/4075267230 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fc4122850 msgr2=0x7f9fc4122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fc4122850 0x7f9fc4122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 -- 10.20.193.78:0/4075267230 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc4115270 msgr2=0x7f9fc411d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc4115270 0x7f9fc411d490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 -- 10.20.193.78:0/4075267230 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fac0094c0 con 0x7f9fc410f060 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc2ffd6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410f060 0x7f9fc411cf50 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb80092b0 tx=0x7f9fb802fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9f9bfff6c0 1 -- 10.20.193.78:0/4075267230 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fb8002ae0 con 0x7f9fc410f060 2026-02-13T02:45:12.249 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9f9bfff6c0 1 -- 10.20.193.78:0/4075267230 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9fb8002c40 con 0x7f9fc410f060 2026-02-13T02:45:12.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb8009590 con 0x7f9fc410f060 2026-02-13T02:45:12.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9f9bfff6c0 1 -- 10.20.193.78:0/4075267230 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fb80372f0 con 0x7f9fc410f060 2026-02-13T02:45:12.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.245+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc4163cd0 con 0x7f9fc410f060 2026-02-13T02:45:12.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.246+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc4110330 con 0x7f9fc410f060 2026-02-13T02:45:12.250 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.248+0000 7f9f9bfff6c0 1 -- 10.20.193.78:0/4075267230 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f9fb8007260 con 0x7f9fc410f060 2026-02-13T02:45:12.251 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.250+0000 7f9f9bfff6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f940b56d0 0x7f9f940d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:12.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.250+0000 7f9f9bfff6c0 1 -- 10.20.193.78:0/4075267230 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f9fb8107d60 con 0x7f9fc410f060 2026-02-13T02:45:12.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.250+0000 7f9fc27fc6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f940b56d0 0x7f9f940d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:12.252 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.250+0000 7f9f9bfff6c0 1 -- 10.20.193.78:0/4075267230 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9fb81081e0 con 0x7f9fc410f060 2026-02-13T02:45:12.254 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.253+0000 7f9fc27fc6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f940b56d0 0x7f9f940d5b80 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fc41238e0 tx=0x7f9fac009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.373+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9fc410f430 con 0x7f9fc410f060 2026-02-13T02:45:12.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.373+0000 7f9f9bfff6c0 1 -- 10.20.193.78:0/4075267230 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9fb80ca680 con 0x7f9fc410f060 2026-02-13T02:45:12.375 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:12.376 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.374+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f940b56d0 msgr2=0x7f9f940d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:12.376 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.374+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f940b56d0 0x7f9f940d5b80 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fc41238e0 tx=0x7f9fac009260 comp rx=0 tx=0).stop 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410f060 msgr2=0x7f9fc411cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410f060 0x7f9fc411cf50 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fb80092b0 tx=0x7f9fb802fca0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 shutdown_connections 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f9f940b56d0 0x7f9f940d5b80 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fc4122850 0x7f9fc4122cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fc4115270 0x7f9fc411d490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 --2- 10.20.193.78:0/4075267230 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9fc410f060 0x7f9fc411cf50 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 >> 10.20.193.78:0/4075267230 conn(0x7f9fc40ec980 msgr2=0x7f9fc410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 shutdown_connections 2026-02-13T02:45:12.377 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:12.375+0000 7f9fc3fff6c0 1 -- 10.20.193.78:0/4075267230 wait complete. 2026-02-13T02:45:12.435 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:12 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4075267230' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:12.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:12 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4075267230' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:12.766 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:12 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4075267230' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:13.695 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:13 trial091 ceph-mon[27614]: pgmap v287: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:13.727 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:13 trial078 ceph-mon[22944]: pgmap v287: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:13.765 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:13 trial154 ceph-mon[27921]: pgmap v287: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:15.481 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:15.668 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:15.796 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:15 trial078 ceph-mon[22944]: pgmap v288: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:15.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 -- 10.20.193.78:0/617952063 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e411a8a0 msgr2=0x7fb7e417b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:15.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/617952063 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417b240 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=14917843327359577481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7d400aa70 tx=0x7fb7d402fde0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 -- 10.20.193.78:0/617952063 shutdown_connections 2026-02-13T02:45:15.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/617952063 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417b240 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=14917843327359577481 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/617952063 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e4115080 0x7fb7e411a0c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.862 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/617952063 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb7e4114690 0x7fb7e4114a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 -- 10.20.193.78:0/617952063 >> 10.20.193.78:0/617952063 conn(0x7fb7e405cd80 msgr2=0x7fb7e405d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:15.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 -- 10.20.193.78:0/617952063 shutdown_connections 2026-02-13T02:45:15.863 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.860+0000 7fb7e35776c0 1 -- 10.20.193.78:0/617952063 wait complete. 2026-02-13T02:45:15.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 Processor -- start 2026-02-13T02:45:15.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 -- start start 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb7e4114690 0x7fb7e417fe20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417e390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e417e8d0 0x7fb7e417ed70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e416f2c0 con 0x7fb7e417e8d0 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e416f430 con 0x7fb7e411a8a0 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e35776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e416f5f0 con 0x7fb7e4114690 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e2d766c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e417e8d0 0x7fb7e417ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e1d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417e390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e1d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417e390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:53852/0 (socket says 10.20.193.78:53852) 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e25756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb7e4114690 0x7fb7e417fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:15.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.861+0000 7fb7e1d746c0 1 -- 10.20.193.78:0/232244463 learned_addr learned my addr 10.20.193.78:0/232244463 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e1d746c0 1 -- 10.20.193.78:0/232244463 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb7e4114690 msgr2=0x7fb7e417fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e1d746c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb7e4114690 0x7fb7e417fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e1d746c0 1 -- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e417e8d0 msgr2=0x7fb7e417ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e1d746c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e417e8d0 0x7fb7e417ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e1d746c0 1 -- 10.20.193.78:0/232244463 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d400a660 con 0x7fb7e411a8a0 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e2d766c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e417e8d0 0x7fb7e417ed70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e1d746c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417e390 secure :-1 s=READY pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7cc00b800 tx=0x7fb7cc00bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7cb7fe6c0 1 -- 10.20.193.78:0/232244463 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7cc004a80 con 0x7fb7e411a8a0 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7cb7fe6c0 1 -- 10.20.193.78:0/232244463 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb7cc009070 con 0x7fb7e411a8a0 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e416f8d0 con 0x7fb7e411a8a0 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e416fdb0 con 0x7fb7e411a8a0 2026-02-13T02:45:15.866 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.862+0000 7fb7cb7fe6c0 1 -- 10.20.193.78:0/232244463 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7cc00ce70 con 0x7fb7e411a8a0 2026-02-13T02:45:15.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.863+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e4115960 con 0x7fb7e411a8a0 2026-02-13T02:45:15.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.865+0000 7fb7cb7fe6c0 1 -- 10.20.193.78:0/232244463 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb7cc004060 con 0x7fb7e411a8a0 2026-02-13T02:45:15.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.867+0000 7fb7cb7fe6c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb7bc0b5650 0x7fb7bc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:15.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.867+0000 7fb7cb7fe6c0 1 -- 10.20.193.78:0/232244463 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fb7cc0e3ad0 con 0x7fb7e411a8a0 2026-02-13T02:45:15.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.867+0000 7fb7cb7fe6c0 1 -- 10.20.193.78:0/232244463 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb7cc11c5e0 con 0x7fb7e411a8a0 2026-02-13T02:45:15.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.867+0000 7fb7e25756c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb7bc0b5650 0x7fb7bc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:15.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.867+0000 7fb7e25756c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb7bc0b5650 0x7fb7bc0d5b00 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7d8004750 tx=0x7fb7d8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:15.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:15 trial091 ceph-mon[27614]: pgmap v288: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:15.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.990+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb7e4115080 con 0x7fb7e411a8a0 2026-02-13T02:45:15.992 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.990+0000 7fb7cb7fe6c0 1 -- 10.20.193.78:0/232244463 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb7cc0a63f0 con 0x7fb7e411a8a0 2026-02-13T02:45:15.992 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:15.993 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:15.993 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb7bc0b5650 msgr2=0x7fb7bc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb7bc0b5650 0x7fb7bc0d5b00 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7d8004750 tx=0x7fb7d8009260 comp rx=0 tx=0).stop 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e411a8a0 msgr2=0x7fb7e417e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417e390 secure :-1 s=READY pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7cc00b800 tx=0x7fb7cc00bcd0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 shutdown_connections 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb7bc0b5650 0x7fb7bc0d5b00 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7e417e8d0 0x7fb7e417ed70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb7e411a8a0 0x7fb7e417e390 unknown :-1 s=CLOSED pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 --2- 10.20.193.78:0/232244463 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb7e4114690 0x7fb7e417fe20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 >> 10.20.193.78:0/232244463 conn(0x7fb7e405cd80 msgr2=0x7fb7e4118f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.991+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 shutdown_connections 2026-02-13T02:45:15.994 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:15.992+0000 7fb7e35776c0 1 -- 10.20.193.78:0/232244463 wait complete. 2026-02-13T02:45:16.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:15 trial154 ceph-mon[27921]: pgmap v288: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:16.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:16 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/232244463' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:16.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:16 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/232244463' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:17.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:16 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/232244463' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:17.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:17 trial091 ceph-mon[27614]: pgmap v289: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:17.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:17 trial078 ceph-mon[22944]: pgmap v289: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:18.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:17 trial154 ceph-mon[27921]: pgmap v289: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:19.098 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:19.283 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.481+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/2721356085 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 msgr2=0x7f6b78111370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.481+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/2721356085 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 0x7f6b78111370 secure :-1 s=READY pgs=254 gs=2 cs=0 l=1 c_cookie=14209699956920876226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b74006fd0 tx=0x7f6b7402fd30 comp rx=0 tx=0).stop 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/2721356085 shutdown_connections 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/2721356085 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 0x7f6b78111370 unknown :-1 s=CLOSED pgs=254 gs=2 cs=0 l=1 c_cookie=14209699956920876226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/2721356085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810c2d0 0x7f6b781108a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/2721356085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b7810b8e0 0x7f6b7810bcb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/2721356085 >> 10.20.193.78:0/2721356085 conn(0x7f6b780e9570 msgr2=0x7f6b78109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:19.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/2721356085 shutdown_connections 2026-02-13T02:45:19.485 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/2721356085 wait complete. 2026-02-13T02:45:19.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.482+0000 7f6b7e6206c0 1 Processor -- start 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7e6206c0 1 -- start start 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7e6206c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810b8e0 0x7f6b781217f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7e6206c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b7810c2d0 0x7f6b78121d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7e6206c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 0x7f6b781270f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7e6206c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78127740 con 0x7f6b78110ef0 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7e6206c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6b781278b0 con 0x7f6b7810b8e0 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7e6206c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78127a70 con 0x7f6b7810c2d0 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810b8e0 0x7f6b781217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810b8e0 0x7f6b781217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:54566/0 (socket says 10.20.193.78:54566) 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 -- 10.20.193.78:0/744264935 learned_addr learned my addr 10.20.193.78:0/744264935 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:19.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7ce1d6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b7810c2d0 0x7f6b78121d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7de1f6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 0x7f6b781270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 -- 10.20.193.78:0/744264935 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b7810c2d0 msgr2=0x7f6b78121d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b7810c2d0 0x7f6b78121d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 -- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 msgr2=0x7f6b781270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 0x7f6b781270f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7d61e6c0 1 -- 10.20.193.78:0/744264935 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7400a5b0 con 0x7f6b7810b8e0 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7ce1d6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b7810c2d0 0x7f6b78121d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.483+0000 7f6b7de1f6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 0x7f6b781270f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.484+0000 7f6b7d61e6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810b8e0 0x7f6b781217f0 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b6800b800 tx=0x7f6b6800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.484+0000 7f6b667fc6c0 1 -- 10.20.193.78:0/744264935 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b68004a80 con 0x7f6b7810b8e0 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.484+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b78127d50 con 0x7f6b7810b8e0 2026-02-13T02:45:19.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.484+0000 7f6b667fc6c0 1 -- 10.20.193.78:0/744264935 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b68009030 con 0x7f6b7810b8e0 2026-02-13T02:45:19.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.484+0000 7f6b667fc6c0 1 -- 10.20.193.78:0/744264935 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b680071c0 con 0x7f6b7810b8e0 2026-02-13T02:45:19.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.484+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b78168430 con 0x7f6b7810b8e0 2026-02-13T02:45:19.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.484+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b40005310 con 0x7f6b7810b8e0 2026-02-13T02:45:19.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.488+0000 7f6b667fc6c0 1 -- 10.20.193.78:0/744264935 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6b6800c7a0 con 0x7f6b7810b8e0 2026-02-13T02:45:19.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.489+0000 7f6b667fc6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6b540b56d0 0x7f6b540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:19.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.490+0000 7f6b667fc6c0 1 -- 10.20.193.78:0/744264935 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f6b680e3c20 con 0x7f6b7810b8e0 2026-02-13T02:45:19.491 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.490+0000 7f6b7ce1d6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6b540b56d0 0x7f6b540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:19.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.490+0000 7f6b667fc6c0 1 -- 10.20.193.78:0/744264935 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6b6811c680 con 0x7f6b7810b8e0 2026-02-13T02:45:19.492 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.490+0000 7f6b7ce1d6c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6b540b56d0 0x7f6b540d5b80 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b78128180 tx=0x7f6b6c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.613+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6b40005960 con 0x7f6b7810b8e0 2026-02-13T02:45:19.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.613+0000 7f6b667fc6c0 1 -- 10.20.193.78:0/744264935 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6b680a6540 con 0x7f6b7810b8e0 2026-02-13T02:45:19.615 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:19.616 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:19.616 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6b540b56d0 msgr2=0x7f6b540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6b540b56d0 0x7f6b540d5b80 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b78128180 tx=0x7f6b6c009260 comp rx=0 tx=0).stop 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810b8e0 msgr2=0x7f6b781217f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810b8e0 0x7f6b781217f0 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b6800b800 tx=0x7f6b6800bcd0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 shutdown_connections 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f6b540b56d0 0x7f6b540d5b80 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78110ef0 0x7f6b781270f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b7810c2d0 0x7f6b78121d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 --2- 10.20.193.78:0/744264935 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b7810b8e0 0x7f6b781217f0 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 >> 10.20.193.78:0/744264935 conn(0x7f6b780e9570 msgr2=0x7f6b78109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:19.617 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 shutdown_connections 2026-02-13T02:45:19.618 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:19.615+0000 7f6b7e6206c0 1 -- 10.20.193.78:0/744264935 wait complete. 2026-02-13T02:45:19.675 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:19 trial078 ceph-mon[22944]: pgmap v290: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:19.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:19 trial091 ceph-mon[27614]: pgmap v290: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:20.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:19 trial154 ceph-mon[27921]: pgmap v290: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:20.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:20 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/744264935' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:20.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:20 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/744264935' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:21.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:20 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/744264935' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:21.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:21 trial091 ceph-mon[27614]: pgmap v291: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:21.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:21 trial078 ceph-mon[22944]: pgmap v291: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:22.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:21 trial154 ceph-mon[27921]: pgmap v291: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:22.720 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:22.904 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:23.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.097+0000 7fddae3bf6c0 1 -- 10.20.193.78:0/3363707417 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8115270 msgr2=0x7fdda8175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:23.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.097+0000 7fddae3bf6c0 1 --2- 10.20.193.78:0/3363707417 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8115270 0x7fdda8175c10 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=14605242264984440119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdda400aa70 tx=0x7fdda402fde0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.098+0000 7fddae3bf6c0 1 -- 10.20.193.78:0/3363707417 shutdown_connections 2026-02-13T02:45:23.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.098+0000 7fddae3bf6c0 1 --2- 10.20.193.78:0/3363707417 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8115270 0x7fdda8175c10 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=14605242264984440119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.098+0000 7fddae3bf6c0 1 --2- 10.20.193.78:0/3363707417 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda810fa50 0x7fdda8114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.098+0000 7fddae3bf6c0 1 --2- 10.20.193.78:0/3363707417 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda810f060 0x7fdda810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.100 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.098+0000 7fddae3bf6c0 1 -- 10.20.193.78:0/3363707417 >> 10.20.193.78:0/3363707417 conn(0x7fdda80ec980 msgr2=0x7fdda810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:23.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.098+0000 7fddae3bf6c0 1 -- 10.20.193.78:0/3363707417 shutdown_connections 2026-02-13T02:45:23.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.098+0000 7fddae3bf6c0 1 -- 10.20.193.78:0/3363707417 wait complete. 2026-02-13T02:45:23.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 Processor -- start 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 -- start start 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda810f060 0x7fdda811cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda8115270 0x7fdda811d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8122860 0x7fdda8122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8123270 con 0x7fdda8122860 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81233e0 con 0x7fdda810f060 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddae3bf6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81235a0 con 0x7fdda8115270 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddadbbe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8122860 0x7fdda8122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:23.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddad3bd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda810f060 0x7fdda811cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddadbbe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8122860 0x7fdda8122d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47430/0 (socket says 10.20.193.78:47430) 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddadbbe6c0 1 -- 10.20.193.78:0/2485656239 learned_addr learned my addr 10.20.193.78:0/2485656239 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.099+0000 7fddacbbc6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda8115270 0x7fdda811d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddadbbe6c0 1 -- 10.20.193.78:0/2485656239 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda8115270 msgr2=0x7fdda811d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddadbbe6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda8115270 0x7fdda811d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddadbbe6c0 1 -- 10.20.193.78:0/2485656239 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda810f060 msgr2=0x7fdda811cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddadbbe6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda810f060 0x7fdda811cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddadbbe6c0 1 -- 10.20.193.78:0/2485656239 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda400a660 con 0x7fdda8122860 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddacbbc6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda8115270 0x7fdda811d4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddadbbe6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8122860 0x7fdda8122d00 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdda40054b0 tx=0x7fdda40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:23.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fdd967fc6c0 1 -- 10.20.193.78:0/2485656239 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdda4003a30 con 0x7fdda8122860 2026-02-13T02:45:23.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fdd967fc6c0 1 -- 10.20.193.78:0/2485656239 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdda4003b90 con 0x7fdda8122860 2026-02-13T02:45:23.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fdd967fc6c0 1 -- 10.20.193.78:0/2485656239 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdda4038380 con 0x7fdda8122860 2026-02-13T02:45:23.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddae3bf6c0 1 -- 10.20.193.78:0/2485656239 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda81639f0 con 0x7fdda8122860 2026-02-13T02:45:23.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.100+0000 7fddae3bf6c0 1 -- 10.20.193.78:0/2485656239 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda8163e20 con 0x7fdda8122860 2026-02-13T02:45:23.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.101+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda8110330 con 0x7fdda8122860 2026-02-13T02:45:23.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.103+0000 7fdd967fc6c0 1 -- 10.20.193.78:0/2485656239 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fdda4003d00 con 0x7fdda8122860 2026-02-13T02:45:23.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.105+0000 7fdd967fc6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd840b56d0 0x7fdd840d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:23.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.105+0000 7fdd967fc6c0 1 -- 10.20.193.78:0/2485656239 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fdda4108fe0 con 0x7fdda8122860 2026-02-13T02:45:23.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.105+0000 7fddad3bd6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd840b56d0 0x7fdd840d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:23.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.105+0000 7fdd967fc6c0 1 -- 10.20.193.78:0/2485656239 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdda41094d0 con 0x7fdda8122860 2026-02-13T02:45:23.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.105+0000 7fddad3bd6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd840b56d0 0x7fdd840d5b80 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd98004750 tx=0x7fdd98009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:23.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.229+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdda811e0b0 con 0x7fdda8122860 2026-02-13T02:45:23.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.229+0000 7fdd967fc6c0 1 -- 10.20.193.78:0/2485656239 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdda40cb940 con 0x7fdda8122860 2026-02-13T02:45:23.231 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:23.231 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:23.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd840b56d0 msgr2=0x7fdd840d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:23.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd840b56d0 0x7fdd840d5b80 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd98004750 tx=0x7fdd98009390 comp rx=0 tx=0).stop 2026-02-13T02:45:23.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8122860 msgr2=0x7fdda8122d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:23.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8122860 0x7fdda8122d00 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdda40054b0 tx=0x7fdda40054e0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 shutdown_connections 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdd840b56d0 0x7fdd840d5b80 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdda8122860 0x7fdda8122d00 unknown :-1 s=CLOSED pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdda8115270 0x7fdda811d4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 --2- 10.20.193.78:0/2485656239 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdda810f060 0x7fdda811cf60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 >> 10.20.193.78:0/2485656239 conn(0x7fdda80ec980 msgr2=0x7fdda810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 shutdown_connections 2026-02-13T02:45:23.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:23.230+0000 7fdd77fff6c0 1 -- 10.20.193.78:0/2485656239 wait complete. 2026-02-13T02:45:23.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:23 trial091 ceph-mon[27614]: pgmap v292: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:23.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:23 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2485656239' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:23.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:23 trial078 ceph-mon[22944]: pgmap v292: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:23.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:23 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2485656239' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:24.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:23 trial154 ceph-mon[27921]: pgmap v292: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:24.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:23 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2485656239' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:25.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:25 trial091 ceph-mon[27614]: pgmap v293: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:25.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:25 trial078 ceph-mon[22944]: pgmap v293: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:26.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:25 trial154 ceph-mon[27921]: pgmap v293: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:26.338 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:26.523 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:26.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 -- 10.20.193.78:0/2390823063 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810ba80 msgr2=0x7f43d810e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:26.720 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2390823063 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810ba80 0x7f43d810e450 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=13714492794930083589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43cc0098a0 tx=0x7f43cc02ec40 comp rx=0 tx=0).stop 2026-02-13T02:45:26.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 -- 10.20.193.78:0/2390823063 shutdown_connections 2026-02-13T02:45:26.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2390823063 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f43d810eb20 0x7f43d810efc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2390823063 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810ba80 0x7f43d810e450 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=13714492794930083589 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2390823063 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f43d810b170 0x7f43d810b540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 -- 10.20.193.78:0/2390823063 >> 10.20.193.78:0/2390823063 conn(0x7f43d8063d50 msgr2=0x7f43d8109470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:26.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 -- 10.20.193.78:0/2390823063 shutdown_connections 2026-02-13T02:45:26.721 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.718+0000 7f43df2586c0 1 -- 10.20.193.78:0/2390823063 wait complete. 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.719+0000 7f43df2586c0 1 Processor -- start 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.719+0000 7f43df2586c0 1 -- start start 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.719+0000 7f43df2586c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810b170 0x7f43d81220e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43df2586c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f43d810ba80 0x7f43d8122620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43df2586c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f43d810eb20 0x7f43d81279e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43df2586c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f43d8128030 con 0x7f43d810b170 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43df2586c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f43d81281a0 con 0x7f43d810ba80 2026-02-13T02:45:26.723 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43df2586c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43d8128360 con 0x7f43d810eb20 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810b170 0x7f43d81220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810b170 0x7f43d81220e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:36316/0 (socket says 10.20.193.78:36316) 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 -- 10.20.193.78:0/2686409098 learned_addr learned my addr 10.20.193.78:0/2686409098 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43dda556c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f43d810ba80 0x7f43d8122620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43dea576c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f43d810eb20 0x7f43d81279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 -- 10.20.193.78:0/2686409098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f43d810eb20 msgr2=0x7f43d81279e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f43d810eb20 0x7f43d81279e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 -- 10.20.193.78:0/2686409098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f43d810ba80 msgr2=0x7f43d8122620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f43d810ba80 0x7f43d8122620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 -- 10.20.193.78:0/2686409098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0094c0 con 0x7f43d810b170 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43de2566c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810b170 0x7f43d81220e0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43c8005950 tx=0x7f43c800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:26.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43bf7fe6c0 1 -- 10.20.193.78:0/2686409098 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43c8004460 con 0x7f43d810b170 2026-02-13T02:45:26.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43bf7fe6c0 1 -- 10.20.193.78:0/2686409098 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f43c80045c0 con 0x7f43d810b170 2026-02-13T02:45:26.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43bf7fe6c0 1 -- 10.20.193.78:0/2686409098 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43c8003960 con 0x7f43d810b170 2026-02-13T02:45:26.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d8128640 con 0x7f43d810b170 2026-02-13T02:45:26.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.720+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d8168d20 con 0x7f43d810b170 2026-02-13T02:45:26.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.721+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d8128860 con 0x7f43d810b170 2026-02-13T02:45:26.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.723+0000 7f43bf7fe6c0 1 -- 10.20.193.78:0/2686409098 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f43c80050b0 con 0x7f43d810b170 2026-02-13T02:45:26.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.725+0000 7f43bf7fe6c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f43b40b56d0 0x7f43b40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:26.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.725+0000 7f43bf7fe6c0 1 -- 10.20.193.78:0/2686409098 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f43c80e3b70 con 0x7f43d810b170 2026-02-13T02:45:26.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.725+0000 7f43dda556c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f43b40b56d0 0x7f43b40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:26.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.725+0000 7f43bf7fe6c0 1 -- 10.20.193.78:0/2686409098 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f43c811c5e0 con 0x7f43d810b170 2026-02-13T02:45:26.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.725+0000 7f43dda556c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f43b40b56d0 0x7f43b40d5b80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43d8128a70 tx=0x7f43cc0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.850+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f43d8123230 con 0x7f43d810b170 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.850+0000 7f43bf7fe6c0 1 -- 10.20.193.78:0/2686409098 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f43c80a6490 con 0x7f43d810b170 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f43b40b56d0 msgr2=0x7f43b40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f43b40b56d0 0x7f43b40d5b80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43d8128a70 tx=0x7f43cc0023a0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810b170 msgr2=0x7f43d81220e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:26.852 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810b170 0x7f43d81220e0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43c8005950 tx=0x7f43c800bca0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 shutdown_connections 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f43b40b56d0 0x7f43b40d5b80 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f43d810eb20 0x7f43d81279e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f43d810ba80 0x7f43d8122620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 --2- 10.20.193.78:0/2686409098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f43d810b170 0x7f43d81220e0 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 >> 10.20.193.78:0/2686409098 conn(0x7f43d8063d50 msgr2=0x7f43d810ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 shutdown_connections 2026-02-13T02:45:26.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:26.851+0000 7f43df2586c0 1 -- 10.20.193.78:0/2686409098 wait complete. 2026-02-13T02:45:27.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:27 trial091 ceph-mon[27614]: pgmap v294: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:27.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:27 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2686409098' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:27.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:27 trial078 ceph-mon[22944]: pgmap v294: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:27.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:27 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2686409098' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:28.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:27 trial154 ceph-mon[27921]: pgmap v294: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:28.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:27 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2686409098' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:29.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:29 trial091 ceph-mon[27614]: pgmap v295: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:29.959 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:29.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:29 trial078 ceph-mon[22944]: pgmap v295: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:30.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:29 trial154 ceph-mon[27921]: pgmap v295: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:30.142 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:30.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3624918482 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc1137a0 msgr2=0x7fe0cc113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3624918482 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc113b70 secure :-1 s=READY pgs=158 gs=2 cs=0 l=1 c_cookie=1558450495627044486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b8009970 tx=0x7fe0b802ed50 comp rx=0 tx=0).stop 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3624918482 shutdown_connections 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3624918482 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe0cc116520 0x7fe0cc17a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3624918482 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc114190 0x7fe0cc115d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3624918482 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc113b70 unknown :-1 s=CLOSED pgs=158 gs=2 cs=0 l=1 c_cookie=1558450495627044486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3624918482 >> 10.20.193.78:0/3624918482 conn(0x7fe0cc061510 msgr2=0x7fe0cc061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3624918482 shutdown_connections 2026-02-13T02:45:30.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3624918482 wait complete. 2026-02-13T02:45:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.337+0000 7fe0d14c06c0 1 Processor -- start 2026-02-13T02:45:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d14c06c0 1 -- start start 2026-02-13T02:45:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d14c06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc1215a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d14c06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe0cc116520 0x7fe0cc121ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d14c06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc126e50 0x7fe0cc1272f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:30.341 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d14c06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc127860 con 0x7fe0cc1137a0 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d14c06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1279d0 con 0x7fe0cc126e50 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d14c06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc127b90 con 0x7fe0cc116520 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc1215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cb7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe0cc116520 0x7fe0cc121ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc1215a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:36340/0 (socket says 10.20.193.78:36340) 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 -- 10.20.193.78:0/3221052534 learned_addr learned my addr 10.20.193.78:0/3221052534 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0d0cbf6c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc126e50 0x7fe0cc1272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 -- 10.20.193.78:0/3221052534 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe0cc116520 msgr2=0x7fe0cc121ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:30.342 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe0cc116520 0x7fe0cc121ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 -- 10.20.193.78:0/3221052534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc126e50 msgr2=0x7fe0cc1272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc126e50 0x7fe0cc1272f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 -- 10.20.193.78:0/3221052534 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b8009590 con 0x7fe0cc1137a0 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.338+0000 7fe0cbfff6c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc1215a0 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b80092b0 tx=0x7fe0b80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.339+0000 7fe0c97fa6c0 1 -- 10.20.193.78:0/3221052534 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b8002ae0 con 0x7fe0cc1137a0 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.339+0000 7fe0c97fa6c0 1 -- 10.20.193.78:0/3221052534 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe0b8002c40 con 0x7fe0cc1137a0 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.339+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc167fe0 con 0x7fe0cc1137a0 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.339+0000 7fe0c97fa6c0 1 -- 10.20.193.78:0/3221052534 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0b80372f0 con 0x7fe0cc1137a0 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.339+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc168460 con 0x7fe0cc1137a0 2026-02-13T02:45:30.343 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.339+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0cc114840 con 0x7fe0cc1137a0 2026-02-13T02:45:30.344 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.341+0000 7fe0c97fa6c0 1 -- 10.20.193.78:0/3221052534 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe0b8007260 con 0x7fe0cc1137a0 2026-02-13T02:45:30.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.343+0000 7fe0c97fa6c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0a00b56d0 0x7fe0a00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:30.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.343+0000 7fe0c97fa6c0 1 -- 10.20.193.78:0/3221052534 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fe0b8107cd0 con 0x7fe0cc1137a0 2026-02-13T02:45:30.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.343+0000 7fe0cb7fe6c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0a00b56d0 0x7fe0a00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:30.345 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.343+0000 7fe0c97fa6c0 1 -- 10.20.193.78:0/3221052534 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe0b8108150 con 0x7fe0cc1137a0 2026-02-13T02:45:30.346 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.344+0000 7fe0cb7fe6c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0a00b56d0 0x7fe0a00d5b80 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0cc127ee0 tx=0x7fe0bc009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:30.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.467+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe0cc113b70 con 0x7fe0cc1137a0 2026-02-13T02:45:30.468 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.467+0000 7fe0c97fa6c0 1 -- 10.20.193.78:0/3221052534 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe0b80ca5f0 con 0x7fe0cc1137a0 2026-02-13T02:45:30.469 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:30.469 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0a00b56d0 msgr2=0x7fe0a00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0a00b56d0 0x7fe0a00d5b80 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0cc127ee0 tx=0x7fe0bc009260 comp rx=0 tx=0).stop 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc1137a0 msgr2=0x7fe0cc1215a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc1215a0 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0b80092b0 tx=0x7fe0b80047f0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 shutdown_connections 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0a00b56d0 0x7fe0a00d5b80 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe0cc126e50 0x7fe0cc1272f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe0cc116520 0x7fe0cc121ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.470 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 --2- 10.20.193.78:0/3221052534 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe0cc1137a0 0x7fe0cc1215a0 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:30.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 >> 10.20.193.78:0/3221052534 conn(0x7fe0cc061510 msgr2=0x7fe0cc116d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:30.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 shutdown_connections 2026-02-13T02:45:30.471 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:30.468+0000 7fe0d14c06c0 1 -- 10.20.193.78:0/3221052534 wait complete. 2026-02-13T02:45:30.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:30 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3221052534' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:30.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:30 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3221052534' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:31.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:30 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3221052534' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:31.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:31 trial091 ceph-mon[27614]: pgmap v296: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:31.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:31 trial078 ceph-mon[22944]: pgmap v296: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:32.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:31 trial154 ceph-mon[27921]: pgmap v296: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:33.576 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:33.763 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:33.880 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:33 trial078 ceph-mon[22944]: pgmap v297: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:33.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:33 trial091 ceph-mon[27614]: pgmap v297: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:33.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 -- 10.20.193.78:0/848664532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50341137a0 msgr2=0x7f5034113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:33.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 --2- 10.20.193.78:0/848664532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50341137a0 0x7f5034113b70 secure :-1 s=READY pgs=159 gs=1 cs=0 l=1 c_cookie=12938121818960084628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5020009970 tx=0x7f502002ed50 comp rx=0 tx=0).stop 2026-02-13T02:45:33.967 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 -- 10.20.193.78:0/848664532 shutdown_connections 2026-02-13T02:45:33.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 --2- 10.20.193.78:0/848664532 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 0x7f503417a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:33.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 --2- 10.20.193.78:0/848664532 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5034114190 0x7f5034115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:33.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 --2- 10.20.193.78:0/848664532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50341137a0 0x7f5034113b70 unknown :-1 s=CLOSED pgs=159 gs=1 cs=0 l=1 c_cookie=12938121818960084628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:33.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 -- 10.20.193.78:0/848664532 >> 10.20.193.78:0/848664532 conn(0x7f5034061510 msgr2=0x7f5034061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:33.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 -- 10.20.193.78:0/848664532 shutdown_connections 2026-02-13T02:45:33.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.965+0000 7f50389876c0 1 -- 10.20.193.78:0/848664532 wait complete. 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 Processor -- start 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 -- start start 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50341137a0 0x7f5034121540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 0x7f5034121a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5034126e40 0x7f50341272e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5034127850 con 0x7f50341137a0 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f50341279c0 con 0x7f5034126e40 2026-02-13T02:45:33.970 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.966+0000 7f50389876c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5034127b80 con 0x7f5034116520 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 0x7f5034121a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 0x7f5034121a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:48234/0 (socket says 10.20.193.78:48234) 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 -- 10.20.193.78:0/1344639252 learned_addr learned my addr 10.20.193.78:0/1344639252 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f50337fe6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50341137a0 0x7f5034121540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5033fff6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5034126e40 0x7f50341272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 -- 10.20.193.78:0/1344639252 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5034126e40 msgr2=0x7f50341272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5034126e40 0x7f50341272e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 -- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50341137a0 msgr2=0x7f5034121540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50341137a0 0x7f5034121540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 -- 10.20.193.78:0/1344639252 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50240094c0 con 0x7f5034116520 2026-02-13T02:45:33.971 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f50337fe6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50341137a0 0x7f5034121540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5032ffd6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 0x7f5034121a80 secure :-1 s=READY pgs=135 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f502400ba30 tx=0x7f502400bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5030ff96c0 1 -- 10.20.193.78:0/1344639252 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5024004250 con 0x7f5034116520 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.967+0000 7f5030ff96c0 1 -- 10.20.193.78:0/1344639252 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5024009070 con 0x7f5034116520 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.968+0000 7f5030ff96c0 1 -- 10.20.193.78:0/1344639252 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f50240071c0 con 0x7f5034116520 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.968+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5020009590 con 0x7f5034116520 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.968+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5034168380 con 0x7f5034116520 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.968+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5034114840 con 0x7f5034116520 2026-02-13T02:45:33.972 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.970+0000 7f5030ff96c0 1 -- 10.20.193.78:0/1344639252 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f50240028c0 con 0x7f5034116520 2026-02-13T02:45:33.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.972+0000 7f5030ff96c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f50080b56d0 0x7f50080d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:33.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.972+0000 7f5030ff96c0 1 -- 10.20.193.78:0/1344639252 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f50240e3d30 con 0x7f5034116520 2026-02-13T02:45:33.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.972+0000 7f50337fe6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f50080b56d0 0x7f50080d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:33.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.972+0000 7f5030ff96c0 1 -- 10.20.193.78:0/1344639252 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50240e41b0 con 0x7f5034116520 2026-02-13T02:45:33.974 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:33.973+0000 7f50337fe6c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f50080b56d0 0x7f50080d5b80 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5020031fd0 tx=0x7f50200023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:34.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:33 trial154 ceph-mon[27921]: pgmap v297: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:34.096 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.095+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5034122690 con 0x7f5034116520 2026-02-13T02:45:34.097 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.095+0000 7f5030ff96c0 1 -- 10.20.193.78:0/1344639252 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f50240a6650 con 0x7f5034116520 2026-02-13T02:45:34.098 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:34.098 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f50080b56d0 msgr2=0x7f50080d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:34.098 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f50080b56d0 0x7f50080d5b80 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5020031fd0 tx=0x7f50200023a0 comp rx=0 tx=0).stop 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 msgr2=0x7f5034121a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 0x7f5034121a80 secure :-1 s=READY pgs=135 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f502400ba30 tx=0x7f502400bf00 comp rx=0 tx=0).stop 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 shutdown_connections 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f50080b56d0 0x7f50080d5b80 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5034126e40 0x7f50341272e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5034116520 0x7f5034121a80 unknown :-1 s=CLOSED pgs=135 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 --2- 10.20.193.78:0/1344639252 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f50341137a0 0x7f5034121540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 >> 10.20.193.78:0/1344639252 conn(0x7f5034061510 msgr2=0x7f5034116d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 shutdown_connections 2026-02-13T02:45:34.099 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:34.096+0000 7f50389876c0 1 -- 10.20.193.78:0/1344639252 wait complete. 2026-02-13T02:45:34.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:34 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1344639252' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:34.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:34 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1344639252' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:35.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:34 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1344639252' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:35.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:35 trial091 ceph-mon[27614]: pgmap v298: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:35 trial078 ceph-mon[22944]: pgmap v298: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:36.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:35 trial154 ceph-mon[27921]: pgmap v298: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:37.201 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:37.386 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:37.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/3191762401 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f81149c0 msgr2=0x7fa4f8114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:37.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/3191762401 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f81149c0 0x7fa4f8114ee0 secure :-1 s=READY pgs=260 gs=2 cs=0 l=1 c_cookie=11059924335087600216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4f400aa40 tx=0x7fa4f402fde0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/3191762401 shutdown_connections 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/3191762401 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f81149c0 0x7fa4f8114ee0 unknown :-1 s=CLOSED pgs=260 gs=2 cs=0 l=1 c_cookie=11059924335087600216 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/3191762401 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4f8113dc0 0x7fa4f8114210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/3191762401 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 0x7fa4f811b8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/3191762401 >> 10.20.193.78:0/3191762401 conn(0x7fa4f8058a50 msgr2=0x7fa4f8058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/3191762401 shutdown_connections 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.581+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/3191762401 wait complete. 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 Processor -- start 2026-02-13T02:45:37.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 -- start start 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f8113dc0 0x7fa4f812b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4f81149c0 0x7fa4f812bd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 0x7fa4f81310d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8131720 con 0x7fa4f8113dc0 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8131890 con 0x7fa4f811b510 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.582+0000 7fa4ff7c56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8131a50 con 0x7fa4f81149c0 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 0x7fa4f81310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fd5366c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f8113dc0 0x7fa4f812b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 0x7fa4f81310d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:51674/0 (socket says 10.20.193.78:51674) 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 -- 10.20.193.78:0/93454218 learned_addr learned my addr 10.20.193.78:0/93454218 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:37.587 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fcd356c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4f81149c0 0x7fa4f812bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 -- 10.20.193.78:0/93454218 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4f81149c0 msgr2=0x7fa4f812bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4f81149c0 0x7fa4f812bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 -- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f8113dc0 msgr2=0x7fa4f812b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f8113dc0 0x7fa4f812b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 -- 10.20.193.78:0/93454218 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f400a660 con 0x7fa4f811b510 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4fdd376c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 0x7fa4f81310d0 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4f400a390 tx=0x7fa4f40054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4e67fc6c0 1 -- 10.20.193.78:0/93454218 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4f4003a30 con 0x7fa4f811b510 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f8131cd0 con 0x7fa4f811b510 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4e67fc6c0 1 -- 10.20.193.78:0/93454218 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa4f4030990 con 0x7fa4f811b510 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.583+0000 7fa4e67fc6c0 1 -- 10.20.193.78:0/93454218 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4f40382f0 con 0x7fa4f811b510 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.584+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f8172410 con 0x7fa4f811b510 2026-02-13T02:45:37.588 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.584+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f805b000 con 0x7fa4f811b510 2026-02-13T02:45:37.589 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.587+0000 7fa4e67fc6c0 1 -- 10.20.193.78:0/93454218 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa4f4003b90 con 0x7fa4f811b510 2026-02-13T02:45:37.590 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.589+0000 7fa4e67fc6c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4d40b56d0 0x7fa4d40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:37.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.589+0000 7fa4e67fc6c0 1 -- 10.20.193.78:0/93454218 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fa4f4108c50 con 0x7fa4f811b510 2026-02-13T02:45:37.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.589+0000 7fa4fd5366c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4d40b56d0 0x7fa4d40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:37.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.589+0000 7fa4e67fc6c0 1 -- 10.20.193.78:0/93454218 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4f41090d0 con 0x7fa4f811b510 2026-02-13T02:45:37.591 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.589+0000 7fa4fd5366c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4d40b56d0 0x7fa4d40d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4e8004750 tx=0x7fa4e8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:37.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.713+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4f812c920 con 0x7fa4f811b510 2026-02-13T02:45:37.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.714+0000 7fa4e67fc6c0 1 -- 10.20.193.78:0/93454218 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa4f40cb570 con 0x7fa4f811b510 2026-02-13T02:45:37.716 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:37.716 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4d40b56d0 msgr2=0x7fa4d40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4d40b56d0 0x7fa4d40d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4e8004750 tx=0x7fa4e8009260 comp rx=0 tx=0).stop 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 msgr2=0x7fa4f81310d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 0x7fa4f81310d0 secure :-1 s=READY pgs=160 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4f400a390 tx=0x7fa4f40054b0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 shutdown_connections 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa4d40b56d0 0x7fa4d40d5b80 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa4f811b510 0x7fa4f81310d0 unknown :-1 s=CLOSED pgs=160 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa4f81149c0 0x7fa4f812bd10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 --2- 10.20.193.78:0/93454218 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa4f8113dc0 0x7fa4f812b7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 >> 10.20.193.78:0/93454218 conn(0x7fa4f8058a50 msgr2=0x7fa4f8119800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 shutdown_connections 2026-02-13T02:45:37.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:37.715+0000 7fa4ff7c56c0 1 -- 10.20.193.78:0/93454218 wait complete. 2026-02-13T02:45:37.775 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:37 trial078 ceph-mon[22944]: pgmap v299: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:37.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:37 trial091 ceph-mon[27614]: pgmap v299: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:38.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:37 trial154 ceph-mon[27921]: pgmap v299: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:38.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:38 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/93454218' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:38.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:38 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/93454218' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:39.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:38 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/93454218' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:39.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:39 trial091 ceph-mon[27614]: pgmap v300: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:39.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:39 trial078 ceph-mon[22944]: pgmap v300: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:40.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:39 trial154 ceph-mon[27921]: pgmap v300: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:40.818 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:41.003 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 -- 10.20.193.78:0/2512799586 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c11b3f0 msgr2=0x7fd62c11b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2512799586 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c11b3f0 0x7fd62c11b7c0 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=17610589197700151047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd61c009970 tx=0x7fd61c02ed10 comp rx=0 tx=0).stop 2026-02-13T02:45:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 -- 10.20.193.78:0/2512799586 shutdown_connections 2026-02-13T02:45:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2512799586 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd62c1199a0 0x7fd62c116df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.190 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2512799586 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd62c118f30 0x7fd62c119380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2512799586 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c11b3f0 0x7fd62c11b7c0 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=17610589197700151047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 -- 10.20.193.78:0/2512799586 >> 10.20.193.78:0/2512799586 conn(0x7fd62c05b290 msgr2=0x7fd62c05b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 -- 10.20.193.78:0/2512799586 shutdown_connections 2026-02-13T02:45:41.191 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.188+0000 7fd6320376c0 1 -- 10.20.193.78:0/2512799586 wait complete. 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 Processor -- start 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 -- start start 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd62c118f30 0x7fd62c0fdcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c1199a0 0x7fd62c0fe1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd62c11b3f0 0x7fd62c1035b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c103c00 con 0x7fd62c11b3f0 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c103d70 con 0x7fd62c1199a0 2026-02-13T02:45:41.193 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6320376c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c103f30 con 0x7fd62c118f30 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6310356c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd62c118f30 0x7fd62c0fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6318366c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd62c11b3f0 0x7fd62c1035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6310356c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd62c118f30 0x7fd62c0fdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:39852/0 (socket says 10.20.193.78:39852) 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6310356c0 1 -- 10.20.193.78:0/2740167998 learned_addr learned my addr 10.20.193.78:0/2740167998 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.189+0000 7fd6308346c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c1199a0 0x7fd62c0fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6318366c0 1 -- 10.20.193.78:0/2740167998 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd62c118f30 msgr2=0x7fd62c0fdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6318366c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd62c118f30 0x7fd62c0fdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6318366c0 1 -- 10.20.193.78:0/2740167998 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c1199a0 msgr2=0x7fd62c0fe1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6318366c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c1199a0 0x7fd62c0fe1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6318366c0 1 -- 10.20.193.78:0/2740167998 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62800a5b0 con 0x7fd62c11b3f0 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6318366c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd62c11b3f0 0x7fd62c1035b0 secure :-1 s=READY pgs=261 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd628006fd0 tx=0x7fd62800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:41.194 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd61a7fc6c0 1 -- 10.20.193.78:0/2740167998 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd628003c40 con 0x7fd62c11b3f0 2026-02-13T02:45:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c009590 con 0x7fd62c11b3f0 2026-02-13T02:45:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c104720 con 0x7fd62c11b3f0 2026-02-13T02:45:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd61a7fc6c0 1 -- 10.20.193.78:0/2740167998 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd62800a070 con 0x7fd62c11b3f0 2026-02-13T02:45:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.190+0000 7fd61a7fc6c0 1 -- 10.20.193.78:0/2740167998 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6280081c0 con 0x7fd62c11b3f0 2026-02-13T02:45:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.191+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c05e670 con 0x7fd62c11b3f0 2026-02-13T02:45:41.195 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.193+0000 7fd61a7fc6c0 1 -- 10.20.193.78:0/2740167998 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd628005030 con 0x7fd62c11b3f0 2026-02-13T02:45:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.194+0000 7fd61a7fc6c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd6080b56d0 0x7fd6080d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:41.196 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.195+0000 7fd61a7fc6c0 1 -- 10.20.193.78:0/2740167998 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fd6280e4bf0 con 0x7fd62c11b3f0 2026-02-13T02:45:41.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.195+0000 7fd6310356c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd6080b56d0 0x7fd6080d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:41.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.195+0000 7fd6310356c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd6080b56d0 0x7fd6080d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd61c0023e0 tx=0x7fd61c005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:41.197 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.195+0000 7fd61a7fc6c0 1 -- 10.20.193.78:0/2740167998 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd6280a75a0 con 0x7fd62c11b3f0 2026-02-13T02:45:41.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.319+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd62c185ef0 con 0x7fd62c11b3f0 2026-02-13T02:45:41.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.319+0000 7fd61a7fc6c0 1 -- 10.20.193.78:0/2740167998 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd6280aa6c0 con 0x7fd62c11b3f0 2026-02-13T02:45:41.321 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:41.321 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd6080b56d0 msgr2=0x7fd6080d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd6080b56d0 0x7fd6080d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd61c0023e0 tx=0x7fd61c005ae0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd62c11b3f0 msgr2=0x7fd62c1035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd62c11b3f0 0x7fd62c1035b0 secure :-1 s=READY pgs=261 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd628006fd0 tx=0x7fd62800cd80 comp rx=0 tx=0).stop 2026-02-13T02:45:41.322 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 shutdown_connections 2026-02-13T02:45:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd6080b56d0 0x7fd6080d5b80 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd62c11b3f0 0x7fd62c1035b0 unknown :-1 s=CLOSED pgs=261 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd62c1199a0 0x7fd62c0fe1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 --2- 10.20.193.78:0/2740167998 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd62c118f30 0x7fd62c0fdcb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 >> 10.20.193.78:0/2740167998 conn(0x7fd62c05b290 msgr2=0x7fd62c0f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.320+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 shutdown_connections 2026-02-13T02:45:41.323 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:41.321+0000 7fd6320376c0 1 -- 10.20.193.78:0/2740167998 wait complete. 2026-02-13T02:45:41.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:41 trial091 ceph-mon[27614]: pgmap v301: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:41.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:41 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2740167998' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:41.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:41 trial078 ceph-mon[22944]: pgmap v301: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:41.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:41 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2740167998' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:42.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:41 trial154 ceph-mon[27921]: pgmap v301: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:42.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:41 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2740167998' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:43.947 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:43 trial091 ceph-mon[27614]: pgmap v302: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:43.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:43 trial078 ceph-mon[22944]: pgmap v302: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:43 trial154 ceph-mon[27921]: pgmap v302: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:44.432 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:44.618 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:44.816 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3636315749 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef441137a0 msgr2=0x7fef44113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3636315749 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef441137a0 0x7fef44113b70 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=13978532371576045059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef340098d0 tx=0x7fef3402ec40 comp rx=0 tx=0).stop 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3636315749 shutdown_connections 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3636315749 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef44116520 0x7fef4417a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3636315749 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fef44114190 0x7fef44115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3636315749 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef441137a0 0x7fef44113b70 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=13978532371576045059 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3636315749 >> 10.20.193.78:0/3636315749 conn(0x7fef44061510 msgr2=0x7fef44061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3636315749 shutdown_connections 2026-02-13T02:45:44.817 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.814+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3636315749 wait complete. 2026-02-13T02:45:44.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.815+0000 7fef4b1036c0 1 Processor -- start 2026-02-13T02:45:44.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.815+0000 7fef4b1036c0 1 -- start start 2026-02-13T02:45:44.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4b1036c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef441137a0 0x7fef441214f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:44.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4b1036c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fef44116520 0x7fef44121a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:44.819 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4b1036c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef44126df0 0x7fef44127290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4b1036c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fef44127800 con 0x7fef44126df0 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4b1036c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fef44127970 con 0x7fef44116520 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4b1036c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fef44127b30 con 0x7fef441137a0 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef441137a0 0x7fef441214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef441137a0 0x7fef441214f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:39868/0 (socket says 10.20.193.78:39868) 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 -- 10.20.193.78:0/3419624274 learned_addr learned my addr 10.20.193.78:0/3419624274 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a9026c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef44126df0 0x7fef44127290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef499006c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fef44116520 0x7fef44121a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 -- 10.20.193.78:0/3419624274 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fef44116520 msgr2=0x7fef44121a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fef44116520 0x7fef44121a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.820 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 -- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef44126df0 msgr2=0x7fef44127290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef44126df0 0x7fef44127290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a1016c0 1 -- 10.20.193.78:0/3419624274 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef340094c0 con 0x7fef441137a0 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.816+0000 7fef4a9026c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef44126df0 0x7fef44127290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.817+0000 7fef4a1016c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef441137a0 0x7fef441214f0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef340023a0 tx=0x7fef3402fba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.817+0000 7fef2b7fe6c0 1 -- 10.20.193.78:0/3419624274 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef34002ae0 con 0x7fef441137a0 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.817+0000 7fef2b7fe6c0 1 -- 10.20.193.78:0/3419624274 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fef340076a0 con 0x7fef441137a0 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.817+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef44167f80 con 0x7fef441137a0 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.817+0000 7fef2b7fe6c0 1 -- 10.20.193.78:0/3419624274 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef34031550 con 0x7fef441137a0 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.817+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef441683b0 con 0x7fef441137a0 2026-02-13T02:45:44.821 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.817+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef44114840 con 0x7fef441137a0 2026-02-13T02:45:44.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.820+0000 7fef2b7fe6c0 1 -- 10.20.193.78:0/3419624274 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fef34002c40 con 0x7fef441137a0 2026-02-13T02:45:44.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.821+0000 7fef2b7fe6c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fef200b5650 0x7fef200d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:44.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.821+0000 7fef2b7fe6c0 1 -- 10.20.193.78:0/3419624274 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fef34107e60 con 0x7fef441137a0 2026-02-13T02:45:44.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.821+0000 7fef2b7fe6c0 1 -- 10.20.193.78:0/3419624274 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fef341082e0 con 0x7fef441137a0 2026-02-13T02:45:44.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.821+0000 7fef499006c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fef200b5650 0x7fef200d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:44.824 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.822+0000 7fef499006c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fef200b5650 0x7fef200d5b00 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef38005980 tx=0x7fef38005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:44.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.946+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fef44113b70 con 0x7fef441137a0 2026-02-13T02:45:44.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.946+0000 7fef2b7fe6c0 1 -- 10.20.193.78:0/3419624274 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fef340ca780 con 0x7fef441137a0 2026-02-13T02:45:44.948 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:44.948 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:44.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fef200b5650 msgr2=0x7fef200d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:44.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fef200b5650 0x7fef200d5b00 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef38005980 tx=0x7fef38005910 comp rx=0 tx=0).stop 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef441137a0 msgr2=0x7fef441214f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef441137a0 0x7fef441214f0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef340023a0 tx=0x7fef3402fba0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 shutdown_connections 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fef200b5650 0x7fef200d5b00 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fef44126df0 0x7fef44127290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fef44116520 0x7fef44121a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 --2- 10.20.193.78:0/3419624274 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fef441137a0 0x7fef441214f0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 >> 10.20.193.78:0/3419624274 conn(0x7fef44061510 msgr2=0x7fef44116d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 shutdown_connections 2026-02-13T02:45:44.950 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:44.947+0000 7fef4b1036c0 1 -- 10.20.193.78:0/3419624274 wait complete. 2026-02-13T02:45:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:45 trial091 ceph-mon[27614]: pgmap v303: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:45.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:45 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3419624274' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:45.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:45 trial078 ceph-mon[22944]: pgmap v303: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:45.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:45 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3419624274' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:46.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:45 trial154 ceph-mon[27921]: pgmap v303: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:46.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:45 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3419624274' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:47.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:47 trial091 ceph-mon[27614]: pgmap v304: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:47.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:47 trial078 ceph-mon[22944]: pgmap v304: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:48.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:47 trial154 ceph-mon[27921]: pgmap v304: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:48.056 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:48.242 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 -- 10.20.193.78:0/2875319762 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b010f060 msgr2=0x7f06b010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 --2- 10.20.193.78:0/2875319762 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b010f060 0x7f06b010f430 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=5571351782375933711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06a40099a0 tx=0x7f06a402ed20 comp rx=0 tx=0).stop 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 -- 10.20.193.78:0/2875319762 shutdown_connections 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 --2- 10.20.193.78:0/2875319762 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06b0115270 0x7f06b0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 --2- 10.20.193.78:0/2875319762 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06b010fa50 0x7f06b0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 --2- 10.20.193.78:0/2875319762 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b010f060 0x7f06b010f430 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=5571351782375933711 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 -- 10.20.193.78:0/2875319762 >> 10.20.193.78:0/2875319762 conn(0x7f06b00ec980 msgr2=0x7f06b010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 -- 10.20.193.78:0/2875319762 shutdown_connections 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.449+0000 7f06b493f6c0 1 -- 10.20.193.78:0/2875319762 wait complete. 2026-02-13T02:45:48.451 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.450+0000 7f06b493f6c0 1 Processor -- start 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.450+0000 7f06b493f6c0 1 -- start start 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06b493f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06b010f060 0x7f06b011cf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06b493f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06b0115270 0x7f06b011d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06b493f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b0122880 0x7f06b0122d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06b493f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06b0123290 con 0x7f06b0122880 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06b493f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f06b0123400 con 0x7f06b010f060 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06b493f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06b01235c0 con 0x7f06b0115270 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06af5776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b0122880 0x7f06b0122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06ae5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06b0115270 0x7f06b011d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06aed766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06b010f060 0x7f06b011cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06aed766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06b010f060 0x7f06b011cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:49492/0 (socket says 10.20.193.78:49492) 2026-02-13T02:45:48.452 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06aed766c0 1 -- 10.20.193.78:0/1864225651 learned_addr learned my addr 10.20.193.78:0/1864225651 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06af5776c0 1 -- 10.20.193.78:0/1864225651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06b0115270 msgr2=0x7f06b011d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06af5776c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06b0115270 0x7f06b011d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06af5776c0 1 -- 10.20.193.78:0/1864225651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06b010f060 msgr2=0x7f06b011cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06af5776c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06b010f060 0x7f06b011cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06af5776c0 1 -- 10.20.193.78:0/1864225651 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a4009590 con 0x7f06b0122880 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.451+0000 7f06af5776c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b0122880 0x7f06b0122d20 secure :-1 s=READY pgs=264 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06a0006fd0 tx=0x7f06a000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.452+0000 7f068ffff6c0 1 -- 10.20.193.78:0/1864225651 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06a0003c40 con 0x7f06b0122880 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.452+0000 7f06b493f6c0 1 -- 10.20.193.78:0/1864225651 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b0163a70 con 0x7f06b0122880 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.452+0000 7f068ffff6c0 1 -- 10.20.193.78:0/1864225651 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f06a000a070 con 0x7f06b0122880 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.452+0000 7f068ffff6c0 1 -- 10.20.193.78:0/1864225651 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06a000de50 con 0x7f06b0122880 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.452+0000 7f06b493f6c0 1 -- 10.20.193.78:0/1864225651 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b0163f50 con 0x7f06b0122880 2026-02-13T02:45:48.453 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.452+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b0110330 con 0x7f06b0122880 2026-02-13T02:45:48.456 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.455+0000 7f068ffff6c0 1 -- 10.20.193.78:0/1864225651 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f06a0005030 con 0x7f06b0122880 2026-02-13T02:45:48.457 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.456+0000 7f068ffff6c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06840b56d0 0x7f06840d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:48.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.456+0000 7f068ffff6c0 1 -- 10.20.193.78:0/1864225651 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f06a00e4b80 con 0x7f06b0122880 2026-02-13T02:45:48.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.456+0000 7f068ffff6c0 1 -- 10.20.193.78:0/1864225651 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f06a011d5e0 con 0x7f06b0122880 2026-02-13T02:45:48.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.456+0000 7f06aed766c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06840b56d0 0x7f06840d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:48.458 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.457+0000 7f06aed766c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06840b56d0 0x7f06840d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06a4005980 tx=0x7f06a4005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:48.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.581+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f06b011e0d0 con 0x7f06b0122880 2026-02-13T02:45:48.584 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.582+0000 7f068ffff6c0 1 -- 10.20.193.78:0/1864225651 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f06a00a74a0 con 0x7f06b0122880 2026-02-13T02:45:48.584 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:48.584 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:48.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06840b56d0 msgr2=0x7f06840d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:48.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06840b56d0 0x7f06840d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06a4005980 tx=0x7f06a4005910 comp rx=0 tx=0).stop 2026-02-13T02:45:48.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b0122880 msgr2=0x7f06b0122d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:48.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b0122880 0x7f06b0122d20 secure :-1 s=READY pgs=264 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06a0006fd0 tx=0x7f06a000cc00 comp rx=0 tx=0).stop 2026-02-13T02:45:48.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 shutdown_connections 2026-02-13T02:45:48.585 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f06840b56d0 0x7f06840d5b80 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06b0122880 0x7f06b0122d20 unknown :-1 s=CLOSED pgs=264 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06b0115270 0x7f06b011d4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 --2- 10.20.193.78:0/1864225651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f06b010f060 0x7f06b011cf80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:48.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 >> 10.20.193.78:0/1864225651 conn(0x7f06b00ec980 msgr2=0x7f06b010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:48.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 shutdown_connections 2026-02-13T02:45:48.586 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:48.583+0000 7f068dffb6c0 1 -- 10.20.193.78:0/1864225651 wait complete. 2026-02-13T02:45:48.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:48 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1864225651' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:48.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:48 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1864225651' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:49.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:48 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1864225651' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:49.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:49 trial091 ceph-mon[27614]: pgmap v305: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:49.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:49 trial078 ceph-mon[22944]: pgmap v305: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:50.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:49 trial154 ceph-mon[27921]: pgmap v305: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:45:51.689 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:51.875 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:51.917 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:51 trial078 ceph-mon[22944]: pgmap v306: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:51.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:51 trial091 ceph-mon[27614]: pgmap v306: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:52.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:51 trial154 ceph-mon[27921]: pgmap v306: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:45:52.071 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/888517209 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c010f060 msgr2=0x7fd7c010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/888517209 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c010f060 0x7fd7c010f430 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=6539037206376590115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7b00099a0 tx=0x7fd7b002ed00 comp rx=0 tx=0).stop 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/888517209 shutdown_connections 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/888517209 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd7c0115270 0x7fd7c0175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/888517209 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7c010fa50 0x7fd7c0114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/888517209 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c010f060 0x7fd7c010f430 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=6539037206376590115 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/888517209 >> 10.20.193.78:0/888517209 conn(0x7fd7c00ec980 msgr2=0x7fd7c010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.069+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/888517209 shutdown_connections 2026-02-13T02:45:52.072 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.070+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/888517209 wait complete. 2026-02-13T02:45:52.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.070+0000 7fd7c5c336c0 1 Processor -- start 2026-02-13T02:45:52.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.070+0000 7fd7c5c336c0 1 -- start start 2026-02-13T02:45:52.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c5c336c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd7c010f060 0x7fd7c011cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:52.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c5c336c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7c0115270 0x7fd7c011d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:52.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c5c336c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c0122830 0x7fd7c0122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:52.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c5c336c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0123240 con 0x7fd7c0122830 2026-02-13T02:45:52.074 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c5c336c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c01233b0 con 0x7fd7c0115270 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c5c336c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0123570 con 0x7fd7c010f060 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7b7fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7c0115270 0x7fd7c011d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c54326c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c0122830 0x7fd7c0122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c4c316c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd7c010f060 0x7fd7c011cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c4c316c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd7c010f060 0x7fd7c011cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:38904/0 (socket says 10.20.193.78:38904) 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c4c316c0 1 -- 10.20.193.78:0/4093376346 learned_addr learned my addr 10.20.193.78:0/4093376346 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c54326c0 1 -- 10.20.193.78:0/4093376346 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd7c010f060 msgr2=0x7fd7c011cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c54326c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd7c010f060 0x7fd7c011cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c54326c0 1 -- 10.20.193.78:0/4093376346 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7c0115270 msgr2=0x7fd7c011d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c54326c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7c0115270 0x7fd7c011d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.075 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c54326c0 1 -- 10.20.193.78:0/4093376346 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b0009590 con 0x7fd7c0122830 2026-02-13T02:45:52.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7c54326c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c0122830 0x7fd7c0122cd0 secure :-1 s=READY pgs=266 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7bc006fd0 tx=0x7fd7bc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:52.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7b5ffb6c0 1 -- 10.20.193.78:0/4093376346 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7bc003c40 con 0x7fd7c0122830 2026-02-13T02:45:52.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7b5ffb6c0 1 -- 10.20.193.78:0/4093376346 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd7bc00a070 con 0x7fd7c0122830 2026-02-13T02:45:52.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.071+0000 7fd7b5ffb6c0 1 -- 10.20.193.78:0/4093376346 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd7bc00dd90 con 0x7fd7c0122830 2026-02-13T02:45:52.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.072+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c0163a20 con 0x7fd7c0122830 2026-02-13T02:45:52.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.072+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c0163eb0 con 0x7fd7c0122830 2026-02-13T02:45:52.076 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.072+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c0110330 con 0x7fd7c0122830 2026-02-13T02:45:52.077 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.074+0000 7fd7b5ffb6c0 1 -- 10.20.193.78:0/4093376346 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd7bc005030 con 0x7fd7c0122830 2026-02-13T02:45:52.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.076+0000 7fd7b5ffb6c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd79c0b56d0 0x7fd79c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:52.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.076+0000 7fd7b5ffb6c0 1 -- 10.20.193.78:0/4093376346 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fd7bc0e4b10 con 0x7fd7c0122830 2026-02-13T02:45:52.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.076+0000 7fd7b5ffb6c0 1 -- 10.20.193.78:0/4093376346 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7bc11d5e0 con 0x7fd7c0122830 2026-02-13T02:45:52.078 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.076+0000 7fd7c4c316c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd79c0b56d0 0x7fd79c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:52.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.077+0000 7fd7c4c316c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd79c0b56d0 0x7fd79c0d5b80 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7b00023e0 tx=0x7fd7b0005b00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:52.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.201+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd7c010f430 con 0x7fd7c0122830 2026-02-13T02:45:52.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.201+0000 7fd7b5ffb6c0 1 -- 10.20.193.78:0/4093376346 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd7bc0a7430 con 0x7fd7c0122830 2026-02-13T02:45:52.203 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:52.204 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:52.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.202+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd79c0b56d0 msgr2=0x7fd79c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.202+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd79c0b56d0 0x7fd79c0d5b80 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7b00023e0 tx=0x7fd7b0005b00 comp rx=0 tx=0).stop 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.202+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c0122830 msgr2=0x7fd7c0122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.202+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c0122830 0x7fd7c0122cd0 secure :-1 s=READY pgs=266 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7bc006fd0 tx=0x7fd7bc00cc00 comp rx=0 tx=0).stop 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 shutdown_connections 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fd79c0b56d0 0x7fd79c0d5b80 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd7c0122830 0x7fd7c0122cd0 unknown :-1 s=CLOSED pgs=266 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7c0115270 0x7fd7c011d470 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 --2- 10.20.193.78:0/4093376346 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd7c010f060 0x7fd7c011cf30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 >> 10.20.193.78:0/4093376346 conn(0x7fd7c00ec980 msgr2=0x7fd7c010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 shutdown_connections 2026-02-13T02:45:52.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:52.203+0000 7fd7c5c336c0 1 -- 10.20.193.78:0/4093376346 wait complete. 2026-02-13T02:45:52.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:52 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/4093376346' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:52.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:52 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/4093376346' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:53.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:52 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/4093376346' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:53.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:53 trial091 ceph-mon[27614]: pgmap v307: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:53.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:53 trial078 ceph-mon[22944]: pgmap v307: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:53 trial154 ceph-mon[27921]: pgmap v307: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:45:55.342 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:55.524 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:55.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.721+0000 7f79718f46c0 1 -- 10.20.193.78:0/1658587364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c10f200 msgr2=0x7f796c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:55.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.721+0000 7f79718f46c0 1 --2- 10.20.193.78:0/1658587364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c10f200 0x7f796c10f5d0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=12685554874787399518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79600099a0 tx=0x7f796002ed00 comp rx=0 tx=0).stop 2026-02-13T02:45:55.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.721+0000 7f79718f46c0 1 -- 10.20.193.78:0/1658587364 shutdown_connections 2026-02-13T02:45:55.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.721+0000 7f79718f46c0 1 --2- 10.20.193.78:0/1658587364 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c115410 0x7f796c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.721+0000 7f79718f46c0 1 --2- 10.20.193.78:0/1658587364 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f796c10fbf0 0x7f796c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.724 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.721+0000 7f79718f46c0 1 --2- 10.20.193.78:0/1658587364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c10f200 0x7f796c10f5d0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=12685554874787399518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.721+0000 7f79718f46c0 1 -- 10.20.193.78:0/1658587364 >> 10.20.193.78:0/1658587364 conn(0x7f796c0ecb00 msgr2=0x7f796c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:55.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.722+0000 7f79718f46c0 1 -- 10.20.193.78:0/1658587364 shutdown_connections 2026-02-13T02:45:55.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.722+0000 7f79718f46c0 1 -- 10.20.193.78:0/1658587364 wait complete. 2026-02-13T02:45:55.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.722+0000 7f79718f46c0 1 Processor -- start 2026-02-13T02:45:55.725 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.722+0000 7f79718f46c0 1 -- start start 2026-02-13T02:45:55.726 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.722+0000 7f79718f46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c10f200 0x7f796c11d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f79718f46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c115410 0x7f796c11d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f79718f46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f796c122af0 0x7f796c122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f79718f46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f796c1234d0 con 0x7f796c115410 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f79718f46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f796c123640 con 0x7f796c10f200 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f79718f46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f796c123800 con 0x7f796c122af0 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c10f200 0x7f796c11d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c10f200 0x7f796c11d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:49532/0 (socket says 10.20.193.78:49532) 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 -- 10.20.193.78:0/2116036637 learned_addr learned my addr 10.20.193.78:0/2116036637 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796b7fe6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f796c122af0 0x7f796c122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:55.727 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796a7fc6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c115410 0x7f796c11d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 -- 10.20.193.78:0/2116036637 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f796c122af0 msgr2=0x7f796c122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f796c122af0 0x7f796c122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 -- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c115410 msgr2=0x7f796c11d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c115410 0x7f796c11d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 -- 10.20.193.78:0/2116036637 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7960009590 con 0x7f796c10f200 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f796affd6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c10f200 0x7f796c11d1f0 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7960031fd0 tx=0x7f796002fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f79708ee6c0 1 -- 10.20.193.78:0/2116036637 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7960002ae0 con 0x7f796c10f200 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.723+0000 7f79708ee6c0 1 -- 10.20.193.78:0/2116036637 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7960002c40 con 0x7f796c10f200 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.724+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796c163c80 con 0x7f796c10f200 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.724+0000 7f79708ee6c0 1 -- 10.20.193.78:0/2116036637 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7960037360 con 0x7f796c10f200 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.724+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f796c164100 con 0x7f796c10f200 2026-02-13T02:45:55.728 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.724+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796c1104d0 con 0x7f796c10f200 2026-02-13T02:45:55.729 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.726+0000 7f79708ee6c0 1 -- 10.20.193.78:0/2116036637 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7960007260 con 0x7f796c10f200 2026-02-13T02:45:55.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.727+0000 7f79708ee6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f79400b5650 0x7f79400d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:55.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.727+0000 7f79708ee6c0 1 -- 10.20.193.78:0/2116036637 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f7960107f40 con 0x7f796c10f200 2026-02-13T02:45:55.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.728+0000 7f796a7fc6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f79400b5650 0x7f79400d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:55.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.728+0000 7f79708ee6c0 1 -- 10.20.193.78:0/2116036637 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f79601083c0 con 0x7f796c10f200 2026-02-13T02:45:55.730 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.729+0000 7f796a7fc6c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f79400b5650 0x7f79400d5b00 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f796c123b80 tx=0x7f7954009190 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:55.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.851+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f796c10f5d0 con 0x7f796c10f200 2026-02-13T02:45:55.853 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.852+0000 7f79708ee6c0 1 -- 10.20.193.78:0/2116036637 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f79600ca860 con 0x7f796c10f200 2026-02-13T02:45:55.854 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:55.854 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:55.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f79400b5650 msgr2=0x7f79400d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:55.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f79400b5650 0x7f79400d5b00 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f796c123b80 tx=0x7f7954009190 comp rx=0 tx=0).stop 2026-02-13T02:45:55.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c10f200 msgr2=0x7f796c11d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:55.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c10f200 0x7f796c11d1f0 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7960031fd0 tx=0x7f796002fc60 comp rx=0 tx=0).stop 2026-02-13T02:45:55.855 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 shutdown_connections 2026-02-13T02:45:55.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f79400b5650 0x7f79400d5b00 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f796c122af0 0x7f796c122f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796c115410 0x7f796c11d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 --2- 10.20.193.78:0/2116036637 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f796c10f200 0x7f796c11d1f0 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:55.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 >> 10.20.193.78:0/2116036637 conn(0x7f796c0ecb00 msgr2=0x7f796c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:55.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 shutdown_connections 2026-02-13T02:45:55.856 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:55.853+0000 7f79718f46c0 1 -- 10.20.193.78:0/2116036637 wait complete. 2026-02-13T02:45:55.915 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:55 trial078 ceph-mon[22944]: pgmap v308: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:55.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:55 trial091 ceph-mon[27614]: pgmap v308: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:56.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:55 trial154 ceph-mon[27921]: pgmap v308: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:45:56.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:56 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2116036637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:56.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:56 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:45:56.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:56 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2116036637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:56.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:56 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:45:57.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:56 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2116036637' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:57.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:56 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:45:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:57 trial091 ceph-mon[27614]: pgmap v309: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:45:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:45:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:45:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:45:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:45:57.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:57 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:45:57.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:57 trial154 ceph-mon[27921]: pgmap v309: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:57.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:45:57.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:45:57.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:45:57.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:45:57.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:45:57.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:57 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:45:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:57 trial078 ceph-mon[22944]: pgmap v309: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:45:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:45:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:45:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:45:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:45:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:45:57.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:57 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:45:58.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:58 trial091 ceph-mon[27614]: pgmap v310: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 11 op/s 2026-02-13T02:45:58.957 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:45:58.976 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:58 trial078 ceph-mon[22944]: pgmap v310: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 11 op/s 2026-02-13T02:45:59.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:58 trial154 ceph-mon[27921]: pgmap v310: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 11 op/s 2026-02-13T02:45:59.139 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/2496347393 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe028115410 msgr2=0x7fe028175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/2496347393 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe028115410 0x7fe028175db0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=1143318673397501390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe02400aa70 tx=0x7fe02402fde0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/2496347393 shutdown_connections 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/2496347393 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe028115410 0x7fe028175db0 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=1143318673397501390 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/2496347393 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe02810fbf0 0x7fe028114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/2496347393 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe02810f200 0x7fe02810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/2496347393 >> 10.20.193.78:0/2496347393 conn(0x7fe0280ecb00 msgr2=0x7fe02810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.329+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/2496347393 shutdown_connections 2026-02-13T02:45:59.331 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.330+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/2496347393 wait complete. 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 Processor -- start 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 -- start start 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe02810f200 0x7fe02811d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe028115410 0x7fe02811d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe028122a80 0x7fe028122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe028123490 con 0x7fe02810f200 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe028123600 con 0x7fe028122a80 2026-02-13T02:45:59.332 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02f9ab6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0281237c0 con 0x7fe028115410 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02cf1b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe028115410 0x7fe02811d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02df1d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe028122a80 0x7fe028122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02df1d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe028122a80 0x7fe028122f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:34336/0 (socket says 10.20.193.78:34336) 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02df1d6c0 1 -- 10.20.193.78:0/721659149 learned_addr learned my addr 10.20.193.78:0/721659149 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02cf1b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe028115410 0x7fe02811d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:46288/0 (socket says 10.20.193.78:46288) 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.331+0000 7fe02d71c6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe02810f200 0x7fe02811d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02df1d6c0 1 -- 10.20.193.78:0/721659149 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe028115410 msgr2=0x7fe02811d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02df1d6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe028115410 0x7fe02811d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02df1d6c0 1 -- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe02810f200 msgr2=0x7fe02811d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02df1d6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe02810f200 0x7fe02811d180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02df1d6c0 1 -- 10.20.193.78:0/721659149 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02400a660 con 0x7fe028122a80 2026-02-13T02:45:59.333 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02df1d6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe028122a80 0x7fe028122f20 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0240054b0 tx=0x7fe0240054e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:59.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe0167fc6c0 1 -- 10.20.193.78:0/721659149 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe024003a30 con 0x7fe028122a80 2026-02-13T02:45:59.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe0167fc6c0 1 -- 10.20.193.78:0/721659149 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe024030990 con 0x7fe028122a80 2026-02-13T02:45:59.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe028163c10 con 0x7fe028122a80 2026-02-13T02:45:59.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe028164040 con 0x7fe028122a80 2026-02-13T02:45:59.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.332+0000 7fe0167fc6c0 1 -- 10.20.193.78:0/721659149 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe0240382f0 con 0x7fe028122a80 2026-02-13T02:45:59.335 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.333+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0281104d0 con 0x7fe028122a80 2026-02-13T02:45:59.337 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.335+0000 7fe0167fc6c0 1 -- 10.20.193.78:0/721659149 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe024003b90 con 0x7fe028122a80 2026-02-13T02:45:59.338 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.337+0000 7fe0167fc6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0040b5650 0x7fe0040d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:45:59.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.337+0000 7fe0167fc6c0 1 -- 10.20.193.78:0/721659149 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fe024108f10 con 0x7fe028122a80 2026-02-13T02:45:59.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.337+0000 7fe02d71c6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0040b5650 0x7fe0040d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:45:59.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.337+0000 7fe0167fc6c0 1 -- 10.20.193.78:0/721659149 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe024109390 con 0x7fe028122a80 2026-02-13T02:45:59.339 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.337+0000 7fe02d71c6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0040b5650 0x7fe0040d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe018004750 tx=0x7fe018009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:45:59.461 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.459+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe02811e2d0 con 0x7fe028122a80 2026-02-13T02:45:59.462 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.460+0000 7fe0167fc6c0 1 -- 10.20.193.78:0/721659149 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe0240cb830 con 0x7fe028122a80 2026-02-13T02:45:59.462 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:45:59.462 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:45:59.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0040b5650 msgr2=0x7fe0040d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:59.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0040b5650 0x7fe0040d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe018004750 tx=0x7fe018009260 comp rx=0 tx=0).stop 2026-02-13T02:45:59.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe028122a80 msgr2=0x7fe028122f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:45:59.463 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe028122a80 0x7fe028122f20 secure :-1 s=READY pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe0240054b0 tx=0x7fe0240054e0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 shutdown_connections 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fe0040b5650 0x7fe0040d5b00 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe028122a80 0x7fe028122f20 unknown :-1 s=CLOSED pgs=163 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe028115410 0x7fe02811d6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 --2- 10.20.193.78:0/721659149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe02810f200 0x7fe02811d180 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 >> 10.20.193.78:0/721659149 conn(0x7fe0280ecb00 msgr2=0x7fe02810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 shutdown_connections 2026-02-13T02:45:59.464 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:45:59.461+0000 7fe02f9ab6c0 1 -- 10.20.193.78:0/721659149 wait complete. 2026-02-13T02:45:59.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:59 trial091 ceph-mon[27614]: pgmap v311: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:45:59.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:45:59 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/721659149' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:45:59.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:59 trial078 ceph-mon[22944]: pgmap v311: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:45:59.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:45:59 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/721659149' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:59 trial154 ceph-mon[27921]: pgmap v311: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:46:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:45:59 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/721659149' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:01.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:01 trial091 ceph-mon[27614]: pgmap v312: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:46:01.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:01 trial078 ceph-mon[22944]: pgmap v312: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:46:02.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:01 trial154 ceph-mon[27921]: pgmap v312: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:46:02.566 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:02.751 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:02.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 -- 10.20.193.78:0/110149216 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 msgr2=0x7feed017a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:02.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 --2- 10.20.193.78:0/110149216 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed017a100 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=6108717165717258853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feecc00aa70 tx=0x7feecc02fe00 comp rx=0 tx=0).stop 2026-02-13T02:46:02.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 -- 10.20.193.78:0/110149216 shutdown_connections 2026-02-13T02:46:02.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 --2- 10.20.193.78:0/110149216 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed017a100 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=6108717165717258853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:02.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 --2- 10.20.193.78:0/110149216 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feed0114190 0x7feed0115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:02.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 --2- 10.20.193.78:0/110149216 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feed01137a0 0x7feed0113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 -- 10.20.193.78:0/110149216 >> 10.20.193.78:0/110149216 conn(0x7feed0061510 msgr2=0x7feed0061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 -- 10.20.193.78:0/110149216 shutdown_connections 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 -- 10.20.193.78:0/110149216 wait complete. 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.939+0000 7feed68276c0 1 Processor -- start 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed68276c0 1 -- start start 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed68276c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feed01137a0 0x7feed0121460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed68276c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed01219a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed68276c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feed0126d60 0x7feed0127200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed68276c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7feed0127770 con 0x7feed0126d60 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed68276c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7feed01278e0 con 0x7feed01137a0 2026-02-13T02:46:02.944 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed68276c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7feed0127aa0 con 0x7feed0116520 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed01219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed58256c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feed01137a0 0x7feed0121460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed01219a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:46306/0 (socket says 10.20.193.78:46306) 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 -- 10.20.193.78:0/572810774 learned_addr learned my addr 10.20.193.78:0/572810774 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed60266c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feed0126d60 0x7feed0127200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 -- 10.20.193.78:0/572810774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feed01137a0 msgr2=0x7feed0121460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feed01137a0 0x7feed0121460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 -- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feed0126d60 msgr2=0x7feed0127200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feed0126d60 0x7feed0127200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.940+0000 7feed50246c0 1 -- 10.20.193.78:0/572810774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc00a660 con 0x7feed0116520 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.941+0000 7feed50246c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed01219a0 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feec400b800 tx=0x7feec400bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:02.945 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.941+0000 7feebeffd6c0 1 -- 10.20.193.78:0/572810774 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feec4004a80 con 0x7feed0116520 2026-02-13T02:46:02.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.941+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed0167f50 con 0x7feed0116520 2026-02-13T02:46:02.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.941+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed0168430 con 0x7feed0116520 2026-02-13T02:46:02.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.941+0000 7feebeffd6c0 1 -- 10.20.193.78:0/572810774 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feec4009070 con 0x7feed0116520 2026-02-13T02:46:02.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.941+0000 7feebeffd6c0 1 -- 10.20.193.78:0/572810774 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feec400ce70 con 0x7feed0116520 2026-02-13T02:46:02.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.941+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed0114840 con 0x7feed0116520 2026-02-13T02:46:02.946 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.944+0000 7feebeffd6c0 1 -- 10.20.193.78:0/572810774 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7feec4004060 con 0x7feed0116520 2026-02-13T02:46:02.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.945+0000 7feebeffd6c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feeac0b56d0 0x7feeac0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:02.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.945+0000 7feebeffd6c0 1 -- 10.20.193.78:0/572810774 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7feec40e3c10 con 0x7feed0116520 2026-02-13T02:46:02.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.946+0000 7feed58256c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feeac0b56d0 0x7feeac0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:02.948 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.946+0000 7feebeffd6c0 1 -- 10.20.193.78:0/572810774 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feec40e4090 con 0x7feed0116520 2026-02-13T02:46:02.949 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:02.946+0000 7feed58256c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feeac0b56d0 0x7feeac0d5b80 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feec0004750 tx=0x7feec0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:03.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.077+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feed01225b0 con 0x7feed0116520 2026-02-13T02:46:03.079 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.077+0000 7feebeffd6c0 1 -- 10.20.193.78:0/572810774 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7feec40a6530 con 0x7feed0116520 2026-02-13T02:46:03.079 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:03.079 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:03.080 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feeac0b56d0 msgr2=0x7feeac0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feeac0b56d0 0x7feeac0d5b80 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feec0004750 tx=0x7feec0009260 comp rx=0 tx=0).stop 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 msgr2=0x7feed01219a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed01219a0 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feec400b800 tx=0x7feec400bcd0 comp rx=0 tx=0).stop 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 shutdown_connections 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7feeac0b56d0 0x7feeac0d5b80 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feed0126d60 0x7feed0127200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feed0116520 0x7feed01219a0 unknown :-1 s=CLOSED pgs=138 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 --2- 10.20.193.78:0/572810774 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feed01137a0 0x7feed0121460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 >> 10.20.193.78:0/572810774 conn(0x7feed0061510 msgr2=0x7feed0116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:03.081 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 shutdown_connections 2026-02-13T02:46:03.082 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:03.078+0000 7feed68276c0 1 -- 10.20.193.78:0/572810774 wait complete. 2026-02-13T02:46:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:03 trial091 ceph-mon[27614]: pgmap v313: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:46:03.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:03 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/572810774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:03 trial078 ceph-mon[22944]: pgmap v313: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:46:03.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:03 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/572810774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:04.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:03 trial154 ceph-mon[27921]: pgmap v313: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:46:04.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:03 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/572810774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:05.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:05 trial091 ceph-mon[27614]: pgmap v314: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:05.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:05 trial078 ceph-mon[22944]: pgmap v314: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:06.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:05 trial154 ceph-mon[27921]: pgmap v314: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:06.185 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:06.372 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2680442928 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf781149c0 msgr2=0x7faf78114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2680442928 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf781149c0 0x7faf78114ee0 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=17419242831370277471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf7400aa40 tx=0x7faf7402fdf0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.576 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2680442928 shutdown_connections 2026-02-13T02:46:06.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2680442928 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf781149c0 0x7faf78114ee0 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=17419242831370277471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2680442928 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf78113dc0 0x7faf78114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2680442928 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf7811b510 0x7faf7811b8e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2680442928 >> 10.20.193.78:0/2680442928 conn(0x7faf78058a50 msgr2=0x7faf78058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:06.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2680442928 shutdown_connections 2026-02-13T02:46:06.577 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.574+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2680442928 wait complete. 2026-02-13T02:46:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 Processor -- start 2026-02-13T02:46:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 -- start start 2026-02-13T02:46:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf78113dc0 0x7faf7812b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf781149c0 0x7faf7812bd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf7811b510 0x7faf781310d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7faf78131720 con 0x7faf7811b510 2026-02-13T02:46:06.579 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7faf78131890 con 0x7faf78113dc0 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf8060f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf78131a50 con 0x7faf781149c0 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf7e3806c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf78113dc0 0x7faf7812b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf7e3806c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf78113dc0 0x7faf7812b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:37272/0 (socket says 10.20.193.78:37272) 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf7e3806c0 1 -- 10.20.193.78:0/2083107006 learned_addr learned my addr 10.20.193.78:0/2083107006 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.575+0000 7faf7db7f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf781149c0 0x7faf7812bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7eb816c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf7811b510 0x7faf781310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7e3806c0 1 -- 10.20.193.78:0/2083107006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf781149c0 msgr2=0x7faf7812bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7e3806c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf781149c0 0x7faf7812bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7e3806c0 1 -- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf7811b510 msgr2=0x7faf781310d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7e3806c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf7811b510 0x7faf781310d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7e3806c0 1 -- 10.20.193.78:0/2083107006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7400a660 con 0x7faf78113dc0 2026-02-13T02:46:06.580 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7db7f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf781149c0 0x7faf7812bd10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf7e3806c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf78113dc0 0x7faf7812b7d0 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf6800b710 tx=0x7faf6800bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf5f7fe6c0 1 -- 10.20.193.78:0/2083107006 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf68004250 con 0x7faf78113dc0 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf5f7fe6c0 1 -- 10.20.193.78:0/2083107006 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faf68009070 con 0x7faf78113dc0 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf5f7fe6c0 1 -- 10.20.193.78:0/2083107006 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf6800cd70 con 0x7faf78113dc0 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf78131d30 con 0x7faf78113dc0 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.576+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf78172410 con 0x7faf78113dc0 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.577+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf78131f50 con 0x7faf78113dc0 2026-02-13T02:46:06.581 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.579+0000 7faf5f7fe6c0 1 -- 10.20.193.78:0/2083107006 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7faf680028c0 con 0x7faf78113dc0 2026-02-13T02:46:06.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.580+0000 7faf5f7fe6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faf540b56d0 0x7faf540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:06.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.580+0000 7faf5f7fe6c0 1 -- 10.20.193.78:0/2083107006 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7faf680e3bb0 con 0x7faf78113dc0 2026-02-13T02:46:06.582 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.581+0000 7faf7db7f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faf540b56d0 0x7faf540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:06.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.581+0000 7faf7db7f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faf540b56d0 0x7faf540d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf78132160 tx=0x7faf6c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:06.583 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.581+0000 7faf5f7fe6c0 1 -- 10.20.193.78:0/2083107006 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faf680a64d0 con 0x7faf78113dc0 2026-02-13T02:46:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.705+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faf7805b000 con 0x7faf78113dc0 2026-02-13T02:46:06.707 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.705+0000 7faf5f7fe6c0 1 -- 10.20.193.78:0/2083107006 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faf680a9680 con 0x7faf78113dc0 2026-02-13T02:46:06.708 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:06.708 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faf540b56d0 msgr2=0x7faf540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:06.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faf540b56d0 0x7faf540d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf78132160 tx=0x7faf6c009260 comp rx=0 tx=0).stop 2026-02-13T02:46:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf78113dc0 msgr2=0x7faf7812b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf78113dc0 0x7faf7812b7d0 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf6800b710 tx=0x7faf6800bbe0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 shutdown_connections 2026-02-13T02:46:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7faf540b56d0 0x7faf540d5b80 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf7811b510 0x7faf781310d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf781149c0 0x7faf7812bd10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 --2- 10.20.193.78:0/2083107006 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf78113dc0 0x7faf7812b7d0 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 >> 10.20.193.78:0/2083107006 conn(0x7faf78058a50 msgr2=0x7faf78119800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 shutdown_connections 2026-02-13T02:46:06.710 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:06.707+0000 7faf8060f6c0 1 -- 10.20.193.78:0/2083107006 wait complete. 2026-02-13T02:46:07.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:07 trial091 ceph-mon[27614]: pgmap v315: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:46:07.946 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:07 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2083107006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:07.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:07 trial078 ceph-mon[22944]: pgmap v315: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:46:07.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:07 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2083107006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:08.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:07 trial154 ceph-mon[27921]: pgmap v315: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:46:08.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:07 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2083107006' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:09.818 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:09.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:09 trial091 ceph-mon[27614]: pgmap v316: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T02:46:09.976 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:09 trial078 ceph-mon[22944]: pgmap v316: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T02:46:10.005 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:10.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:09 trial154 ceph-mon[27921]: pgmap v316: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T02:46:10.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/1702111675 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a010f200 msgr2=0x7f62a010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/1702111675 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a010f200 0x7f62a010f5d0 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=7072552303942989478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f628c0099a0 tx=0x7f628c02ed00 comp rx=0 tx=0).stop 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/1702111675 shutdown_connections 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/1702111675 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 0x7f62a0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/1702111675 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f62a010fbf0 0x7f62a0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/1702111675 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a010f200 0x7f62a010f5d0 unknown :-1 s=CLOSED pgs=139 gs=1 cs=0 l=1 c_cookie=7072552303942989478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/1702111675 >> 10.20.193.78:0/1702111675 conn(0x7f62a00ecb00 msgr2=0x7f62a010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/1702111675 shutdown_connections 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.201+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/1702111675 wait complete. 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 Processor -- start 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 -- start start 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f62a010f200 0x7f62a011d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 0x7f62a011d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a0122ac0 0x7f62a0122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f62a01234d0 con 0x7f62a0115410 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0123640 con 0x7f62a010f200 2026-02-13T02:46:10.203 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f62a5f1c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0123800 con 0x7f62a0122ac0 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 0x7f62a011d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f62a010f200 0x7f62a011d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 0x7f62a011d700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:46986/0 (socket says 10.20.193.78:46986) 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 -- 10.20.193.78:0/2815491581 learned_addr learned my addr 10.20.193.78:0/2815491581 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629ffff6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a0122ac0 0x7f62a0122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 -- 10.20.193.78:0/2815491581 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a0122ac0 msgr2=0x7f62a0122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a0122ac0 0x7f62a0122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 -- 10.20.193.78:0/2815491581 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f62a010f200 msgr2=0x7f62a011d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f62a010f200 0x7f62a011d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.202+0000 7f629effd6c0 1 -- 10.20.193.78:0/2815491581 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c009590 con 0x7f62a0115410 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.203+0000 7f629effd6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 0x7f62a011d700 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f629000b750 tx=0x7f629000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.203+0000 7f629cff96c0 1 -- 10.20.193.78:0/2815491581 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6290004a80 con 0x7f62a0115410 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.203+0000 7f629cff96c0 1 -- 10.20.193.78:0/2815491581 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6290009030 con 0x7f62a0115410 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.203+0000 7f629cff96c0 1 -- 10.20.193.78:0/2815491581 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f629000cdd0 con 0x7f62a0115410 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.203+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a0163cb0 con 0x7f62a0115410 2026-02-13T02:46:10.204 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.203+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a0164140 con 0x7f62a0115410 2026-02-13T02:46:10.205 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.203+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a01104d0 con 0x7f62a0115410 2026-02-13T02:46:10.207 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.205+0000 7f629cff96c0 1 -- 10.20.193.78:0/2815491581 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6290005020 con 0x7f62a0115410 2026-02-13T02:46:10.208 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.207+0000 7f629cff96c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f62740b56d0 0x7f62740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:10.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.207+0000 7f629cff96c0 1 -- 10.20.193.78:0/2815491581 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f62900e3bb0 con 0x7f62a0115410 2026-02-13T02:46:10.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.207+0000 7f629cff96c0 1 -- 10.20.193.78:0/2815491581 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f629011c620 con 0x7f62a0115410 2026-02-13T02:46:10.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.207+0000 7f629f7fe6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f62740b56d0 0x7f62740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:10.209 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.208+0000 7f629f7fe6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f62740b56d0 0x7f62740d5b80 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f628c005b40 tx=0x7f628c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:10.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.333+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62a010f5d0 con 0x7f62a0115410 2026-02-13T02:46:10.334 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.333+0000 7f629cff96c0 1 -- 10.20.193.78:0/2815491581 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f62900a64d0 con 0x7f62a0115410 2026-02-13T02:46:10.335 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:10.335 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f62740b56d0 msgr2=0x7f62740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f62740b56d0 0x7f62740d5b80 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f628c005b40 tx=0x7f628c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 msgr2=0x7f62a011d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 0x7f62a011d700 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f629000b750 tx=0x7f629000bc20 comp rx=0 tx=0).stop 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 shutdown_connections 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f62740b56d0 0x7f62740d5b80 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f62a0122ac0 0x7f62a0122f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62a0115410 0x7f62a011d700 unknown :-1 s=CLOSED pgs=270 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 --2- 10.20.193.78:0/2815491581 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f62a010f200 0x7f62a011d1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.334+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 >> 10.20.193.78:0/2815491581 conn(0x7f62a00ecb00 msgr2=0x7f62a010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.335+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 shutdown_connections 2026-02-13T02:46:10.336 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:10.335+0000 7f62a5f1c6c0 1 -- 10.20.193.78:0/2815491581 wait complete. 2026-02-13T02:46:10.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:10 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2815491581' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:10.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:10 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2815491581' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:11.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:10 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2815491581' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:11.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:11 trial091 ceph-mon[27614]: pgmap v317: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:46:11.976 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:11 trial078 ceph-mon[22944]: pgmap v317: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:46:12.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:11 trial154 ceph-mon[27921]: pgmap v317: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:46:13.438 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:13.624 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:13.757 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:13 trial078 ceph-mon[22944]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:46:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 -- 10.20.193.78:0/1686427014 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b0410fa50 msgr2=0x7f3b04114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:13.822 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1686427014 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b0410fa50 0x7f3b04114a90 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=8762427812946259123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3aec0098d0 tx=0x7f3aec02ec40 comp rx=0 tx=0).stop 2026-02-13T02:46:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 -- 10.20.193.78:0/1686427014 shutdown_connections 2026-02-13T02:46:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1686427014 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3b04115270 0x7f3b04175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1686427014 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b0410fa50 0x7f3b04114a90 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=8762427812946259123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1686427014 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3b0410f060 0x7f3b0410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 -- 10.20.193.78:0/1686427014 >> 10.20.193.78:0/1686427014 conn(0x7f3b040ec980 msgr2=0x7f3b0410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 -- 10.20.193.78:0/1686427014 shutdown_connections 2026-02-13T02:46:13.823 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.820+0000 7f3b088206c0 1 -- 10.20.193.78:0/1686427014 wait complete. 2026-02-13T02:46:13.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 Processor -- start 2026-02-13T02:46:13.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 -- start start 2026-02-13T02:46:13.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3b0410f060 0x7f3b040f4a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:13.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3b04115270 0x7f3b04175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:13.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b040f5040 0x7f3b040fa310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:13.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040f5730 con 0x7f3b040f5040 2026-02-13T02:46:13.825 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040fa850 con 0x7f3b04115270 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.821+0000 7f3b088206c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3b040faa10 con 0x7f3b0410f060 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b02d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3b0410f060 0x7f3b040f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b035776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b040f5040 0x7f3b040fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b02d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3b0410f060 0x7f3b040f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:48476/0 (socket says 10.20.193.78:48476) 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b02d766c0 1 -- 10.20.193.78:0/1633520311 learned_addr learned my addr 10.20.193.78:0/1633520311 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b025756c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3b04115270 0x7f3b04175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b025756c0 1 -- 10.20.193.78:0/1633520311 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3b0410f060 msgr2=0x7f3b040f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b025756c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3b0410f060 0x7f3b040f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b025756c0 1 -- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b040f5040 msgr2=0x7f3b040fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b025756c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b040f5040 0x7f3b040fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b025756c0 1 -- 10.20.193.78:0/1633520311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af400a5b0 con 0x7f3b04115270 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b035776c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b040f5040 0x7f3b040fa310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:46:13.826 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b025756c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3b04115270 0x7f3b04175b10 secure :-1 s=READY pgs=165 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b04055f00 tx=0x7f3aec02fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3ae3fff6c0 1 -- 10.20.193.78:0/1633520311 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec0045d0 con 0x7f3b04115270 2026-02-13T02:46:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3ae3fff6c0 1 -- 10.20.193.78:0/1633520311 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3aec0071c0 con 0x7f3b04115270 2026-02-13T02:46:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.822+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aec0094c0 con 0x7f3b04115270 2026-02-13T02:46:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.823+0000 7f3ae3fff6c0 1 -- 10.20.193.78:0/1633520311 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3aec0312b0 con 0x7f3b04115270 2026-02-13T02:46:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.823+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b040faf80 con 0x7f3b04115270 2026-02-13T02:46:13.827 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.823+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b04110330 con 0x7f3b04115270 2026-02-13T02:46:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.825+0000 7f3ae3fff6c0 1 -- 10.20.193.78:0/1633520311 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f3aec002ae0 con 0x7f3b04115270 2026-02-13T02:46:13.828 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.827+0000 7f3ae3fff6c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3ad80b5650 0x7f3ad80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.827+0000 7f3ae3fff6c0 1 -- 10.20.193.78:0/1633520311 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f3aec107c00 con 0x7f3b04115270 2026-02-13T02:46:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.827+0000 7f3b02d766c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3ad80b5650 0x7f3ad80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.827+0000 7f3ae3fff6c0 1 -- 10.20.193.78:0/1633520311 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3aec140660 con 0x7f3b04115270 2026-02-13T02:46:13.829 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.827+0000 7f3b02d766c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3ad80b5650 0x7f3ad80d5b00 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af8004750 tx=0x7f3af8009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:13.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:13 trial091 ceph-mon[27614]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:46:13.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.949+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3b040f5b60 con 0x7f3b04115270 2026-02-13T02:46:13.951 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.949+0000 7f3ae3fff6c0 1 -- 10.20.193.78:0/1633520311 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3aec0ca520 con 0x7f3b04115270 2026-02-13T02:46:13.952 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:13.952 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3ad80b5650 msgr2=0x7f3ad80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3ad80b5650 0x7f3ad80d5b00 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3af8004750 tx=0x7f3af8009310 comp rx=0 tx=0).stop 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3b04115270 msgr2=0x7f3b04175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3b04115270 0x7f3b04175b10 secure :-1 s=READY pgs=165 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b04055f00 tx=0x7f3aec02fba0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 shutdown_connections 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3ad80b5650 0x7f3ad80d5b00 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b040f5040 0x7f3b040fa310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.953 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3b04115270 0x7f3b04175b10 unknown :-1 s=CLOSED pgs=165 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 --2- 10.20.193.78:0/1633520311 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3b0410f060 0x7f3b040f4a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:13.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.950+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 >> 10.20.193.78:0/1633520311 conn(0x7f3b040ec980 msgr2=0x7f3b0410d640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:13.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.951+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 shutdown_connections 2026-02-13T02:46:13.954 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:13.951+0000 7f3b088206c0 1 -- 10.20.193.78:0/1633520311 wait complete. 2026-02-13T02:46:14.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:13 trial154 ceph-mon[27921]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T02:46:14.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:14 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1633520311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:14.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:14 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1633520311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:15.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:14 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1633520311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:15.945 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:15 trial091 ceph-mon[27614]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:15.976 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:15 trial078 ceph-mon[22944]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:16.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:15 trial154 ceph-mon[27921]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:17.058 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:17.244 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 -- 10.20.193.78:0/3067947757 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8290118f30 msgr2=0x7f8290119380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 --2- 10.20.193.78:0/3067947757 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8290118f30 0x7f8290119380 secure :-1 s=READY pgs=140 gs=2 cs=0 l=1 c_cookie=6082443457605909774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8278009970 tx=0x7f827802ed10 comp rx=0 tx=0).stop 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 -- 10.20.193.78:0/3067947757 shutdown_connections 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 --2- 10.20.193.78:0/3067947757 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f82901199a0 0x7f8290116df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 --2- 10.20.193.78:0/3067947757 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8290118f30 0x7f8290119380 unknown :-1 s=CLOSED pgs=140 gs=2 cs=0 l=1 c_cookie=6082443457605909774 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 --2- 10.20.193.78:0/3067947757 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f829011b3f0 0x7f829011b7c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 -- 10.20.193.78:0/3067947757 >> 10.20.193.78:0/3067947757 conn(0x7f829005b290 msgr2=0x7f829005b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 -- 10.20.193.78:0/3067947757 shutdown_connections 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.433+0000 7f8294a706c0 1 -- 10.20.193.78:0/3067947757 wait complete. 2026-02-13T02:46:17.435 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 Processor -- start 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 -- start start 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290118f30 0x7f82900fdc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f82901199a0 0x7f82900fe160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829011b3f0 0x7f8290103520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8290103b70 con 0x7f82901199a0 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8290103ce0 con 0x7f8290118f30 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.434+0000 7f8294a706c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8290103ea0 con 0x7f829011b3f0 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f82901199a0 0x7f82900fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828ed766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829011b3f0 0x7f8290103520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f82901199a0 0x7f82900fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:59102/0 (socket says 10.20.193.78:59102) 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 -- 10.20.193.78:0/2300888454 learned_addr learned my addr 10.20.193.78:0/2300888454 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 -- 10.20.193.78:0/2300888454 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829011b3f0 msgr2=0x7f8290103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829011b3f0 0x7f8290103520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 -- 10.20.193.78:0/2300888454 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290118f30 msgr2=0x7f82900fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290118f30 0x7f82900fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.436 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 -- 10.20.193.78:0/2300888454 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82840094c0 con 0x7f82901199a0 2026-02-13T02:46:17.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f828dd746c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f82901199a0 0x7f82900fe160 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8278031fd0 tx=0x7f827802fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:17.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f82777fe6c0 1 -- 10.20.193.78:0/2300888454 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8278002ae0 con 0x7f82901199a0 2026-02-13T02:46:17.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f8294a706c0 1 -- 10.20.193.78:0/2300888454 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8278009590 con 0x7f82901199a0 2026-02-13T02:46:17.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f8294a706c0 1 -- 10.20.193.78:0/2300888454 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8290104690 con 0x7f82901199a0 2026-02-13T02:46:17.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f82777fe6c0 1 -- 10.20.193.78:0/2300888454 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f82780046b0 con 0x7f82901199a0 2026-02-13T02:46:17.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.435+0000 7f82777fe6c0 1 -- 10.20.193.78:0/2300888454 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82780313d0 con 0x7f82901199a0 2026-02-13T02:46:17.437 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.436+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829005e670 con 0x7f82901199a0 2026-02-13T02:46:17.439 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.438+0000 7f82777fe6c0 1 -- 10.20.193.78:0/2300888454 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8278002c40 con 0x7f82901199a0 2026-02-13T02:46:17.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.440+0000 7f82777fe6c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f82680b56d0 0x7f82680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:17.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.440+0000 7f82777fe6c0 1 -- 10.20.193.78:0/2300888454 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f8278107c70 con 0x7f82901199a0 2026-02-13T02:46:17.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.440+0000 7f828e5756c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f82680b56d0 0x7f82680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:17.441 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.440+0000 7f82777fe6c0 1 -- 10.20.193.78:0/2300888454 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f82781080f0 con 0x7f82901199a0 2026-02-13T02:46:17.442 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.441+0000 7f828e5756c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f82680b56d0 0x7f82680d5b80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8284009490 tx=0x7f8284009400 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:17.564 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.563+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f82900fed70 con 0x7f82901199a0 2026-02-13T02:46:17.565 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.563+0000 7f82777fe6c0 1 -- 10.20.193.78:0/2300888454 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f82780ca590 con 0x7f82901199a0 2026-02-13T02:46:17.565 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:17.565 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f82680b56d0 msgr2=0x7f82680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f82680b56d0 0x7f82680d5b80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8284009490 tx=0x7f8284009400 comp rx=0 tx=0).stop 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f82901199a0 msgr2=0x7f82900fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f82901199a0 0x7f82900fe160 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8278031fd0 tx=0x7f827802fc70 comp rx=0 tx=0).stop 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 shutdown_connections 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f82680b56d0 0x7f82680d5b80 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829011b3f0 0x7f8290103520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f82901199a0 0x7f82900fe160 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 --2- 10.20.193.78:0/2300888454 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290118f30 0x7f82900fdc20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 >> 10.20.193.78:0/2300888454 conn(0x7f829005b290 msgr2=0x7f82900f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 shutdown_connections 2026-02-13T02:46:17.566 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:17.565+0000 7f82757fa6c0 1 -- 10.20.193.78:0/2300888454 wait complete. 2026-02-13T02:46:17.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:17 trial078 ceph-mon[22944]: pgmap v320: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:17.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:17 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2300888454' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:18.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:17 trial154 ceph-mon[27921]: pgmap v320: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:18.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:17 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2300888454' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:18.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:17 trial091 ceph-mon[27614]: pgmap v320: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:18.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:17 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2300888454' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:19.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:19 trial078 ceph-mon[22944]: pgmap v321: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:20.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:19 trial154 ceph-mon[27921]: pgmap v321: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:20.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:19 trial091 ceph-mon[27614]: pgmap v321: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:20.667 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:20.852 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:21.045 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 -- 10.20.193.78:0/3413561019 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410fa50 msgr2=0x7fdb64114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 --2- 10.20.193.78:0/3413561019 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410fa50 0x7fdb64114a90 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=6560139445631751984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb4c0099a0 tx=0x7fdb4c02ed00 comp rx=0 tx=0).stop 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 -- 10.20.193.78:0/3413561019 shutdown_connections 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 --2- 10.20.193.78:0/3413561019 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb64115270 0x7fdb64175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 --2- 10.20.193.78:0/3413561019 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410fa50 0x7fdb64114a90 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=6560139445631751984 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 --2- 10.20.193.78:0/3413561019 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb6410f060 0x7fdb6410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 -- 10.20.193.78:0/3413561019 >> 10.20.193.78:0/3413561019 conn(0x7fdb640ec980 msgr2=0x7fdb6410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 -- 10.20.193.78:0/3413561019 shutdown_connections 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.044+0000 7fdb635776c0 1 -- 10.20.193.78:0/3413561019 wait complete. 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 Processor -- start 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 -- start start 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410f060 0x7fdb640f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb64115270 0x7fdb64175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:21.046 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb640f5000 0x7fdb640fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb640f56f0 con 0x7fdb6410f060 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fdb640fa810 con 0x7fdb64115270 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb635776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb640fa9d0 con 0x7fdb640f5000 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb61d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb64115270 0x7fdb64175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb62d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb640f5000 0x7fdb640fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb62d766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb640f5000 0x7fdb640fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:60668/0 (socket says 10.20.193.78:60668) 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb62d766c0 1 -- 10.20.193.78:0/217172072 learned_addr learned my addr 10.20.193.78:0/217172072 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb625756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410f060 0x7fdb640f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.045+0000 7fdb61d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb64115270 0x7fdb64175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:56242/0 (socket says 10.20.193.78:56242) 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb625756c0 1 -- 10.20.193.78:0/217172072 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb640f5000 msgr2=0x7fdb640fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb625756c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb640f5000 0x7fdb640fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb625756c0 1 -- 10.20.193.78:0/217172072 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb64115270 msgr2=0x7fdb64175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb625756c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb64115270 0x7fdb64175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb625756c0 1 -- 10.20.193.78:0/217172072 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c009590 con 0x7fdb6410f060 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb625756c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410f060 0x7fdb640f49d0 secure :-1 s=READY pgs=274 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5800b640 tx=0x7fdb5800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb4b7fe6c0 1 -- 10.20.193.78:0/217172072 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb580044a0 con 0x7fdb6410f060 2026-02-13T02:46:21.047 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb640facb0 con 0x7fdb6410f060 2026-02-13T02:46:21.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb64062870 con 0x7fdb6410f060 2026-02-13T02:46:21.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb4b7fe6c0 1 -- 10.20.193.78:0/217172072 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb58009030 con 0x7fdb6410f060 2026-02-13T02:46:21.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.046+0000 7fdb4b7fe6c0 1 -- 10.20.193.78:0/217172072 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb5800ccb0 con 0x7fdb6410f060 2026-02-13T02:46:21.048 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.047+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb64110330 con 0x7fdb6410f060 2026-02-13T02:46:21.050 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.049+0000 7fdb4b7fe6c0 1 -- 10.20.193.78:0/217172072 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fdb580026b0 con 0x7fdb6410f060 2026-02-13T02:46:21.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.050+0000 7fdb4b7fe6c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb3c0b56d0 0x7fdb3c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:21.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.050+0000 7fdb4b7fe6c0 1 -- 10.20.193.78:0/217172072 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fdb580e3af0 con 0x7fdb6410f060 2026-02-13T02:46:21.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.051+0000 7fdb61d746c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb3c0b56d0 0x7fdb3c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:21.052 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.051+0000 7fdb4b7fe6c0 1 -- 10.20.193.78:0/217172072 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb580a6450 con 0x7fdb6410f060 2026-02-13T02:46:21.053 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.051+0000 7fdb61d746c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb3c0b56d0 0x7fdb3c0d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb640fb360 tx=0x7fdb4c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:21.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.175+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdb640fae40 con 0x7fdb6410f060 2026-02-13T02:46:21.176 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.175+0000 7fdb4b7fe6c0 1 -- 10.20.193.78:0/217172072 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdb640fae40 con 0x7fdb6410f060 2026-02-13T02:46:21.176 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:21.176 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:21.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb3c0b56d0 msgr2=0x7fdb3c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:21.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb3c0b56d0 0x7fdb3c0d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb640fb360 tx=0x7fdb4c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410f060 msgr2=0x7fdb640f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:21.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410f060 0x7fdb640f49d0 secure :-1 s=READY pgs=274 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb5800b640 tx=0x7fdb5800bb10 comp rx=0 tx=0).stop 2026-02-13T02:46:21.177 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 shutdown_connections 2026-02-13T02:46:21.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fdb3c0b56d0 0x7fdb3c0d5b80 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdb640f5000 0x7fdb640fa2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdb64115270 0x7fdb64175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 --2- 10.20.193.78:0/217172072 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb6410f060 0x7fdb640f49d0 unknown :-1 s=CLOSED pgs=274 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:21.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 >> 10.20.193.78:0/217172072 conn(0x7fdb640ec980 msgr2=0x7fdb6410d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:21.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 shutdown_connections 2026-02-13T02:46:21.178 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:21.176+0000 7fdb635776c0 1 -- 10.20.193.78:0/217172072 wait complete. 2026-02-13T02:46:21.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:21 trial078 ceph-mon[22944]: pgmap v322: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:21.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:21 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/217172072' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:22.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:21 trial154 ceph-mon[27921]: pgmap v322: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:22.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:21 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/217172072' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:22.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:21 trial091 ceph-mon[27614]: pgmap v322: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:22.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:21 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/217172072' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:23.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:23 trial078 ceph-mon[22944]: pgmap v323: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:24.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:23 trial154 ceph-mon[27921]: pgmap v323: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:24.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:23 trial091 ceph-mon[27614]: pgmap v323: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:24.318 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:24.503 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:24.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.705+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/835168141 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e0810fbf0 msgr2=0x7f3e08114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:24.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.705+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/835168141 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e0810fbf0 0x7f3e08114c30 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=8940832525495392677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df00098a0 tx=0x7f3df002ec70 comp rx=0 tx=0).stop 2026-02-13T02:46:24.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/835168141 shutdown_connections 2026-02-13T02:46:24.708 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/835168141 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 0x7f3e08175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/835168141 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e0810fbf0 0x7f3e08114c30 unknown :-1 s=CLOSED pgs=166 gs=2 cs=0 l=1 c_cookie=8940832525495392677 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/835168141 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3e0810f200 0x7f3e0810f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/835168141 >> 10.20.193.78:0/835168141 conn(0x7f3e080ecb00 msgr2=0x7f3e0810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/835168141 shutdown_connections 2026-02-13T02:46:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/835168141 wait complete. 2026-02-13T02:46:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.706+0000 7f3e0f1096c0 1 Processor -- start 2026-02-13T02:46:24.709 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0f1096c0 1 -- start start 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0f1096c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3e0810f200 0x7f3e080f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0f1096c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 0x7f3e08175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0f1096c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e080f5120 0x7f3e080fa3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0f1096c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3e080f5810 con 0x7f3e0810f200 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0f1096c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3e080fa930 con 0x7f3e080f5120 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0f1096c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e080faaf0 con 0x7f3e08115410 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 0x7f3e08175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:24.711 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0ce7a6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3e0810f200 0x7f3e080f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 0x7f3e08175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:60676/0 (socket says 10.20.193.78:60676) 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 -- 10.20.193.78:0/1002625842 learned_addr learned my addr 10.20.193.78:0/1002625842 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3e0d67b6c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e080f5120 0x7f3e080fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 -- 10.20.193.78:0/1002625842 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e080f5120 msgr2=0x7f3e080fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e080f5120 0x7f3e080fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 -- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3e0810f200 msgr2=0x7f3e080f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3e0810f200 0x7f3e080f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.707+0000 7f3dfffff6c0 1 -- 10.20.193.78:0/1002625842 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df00094c0 con 0x7f3e08115410 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.708+0000 7f3dfffff6c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 0x7f3e08175cb0 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df00097f0 tx=0x7f3df0005540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.708+0000 7f3dfdffb6c0 1 -- 10.20.193.78:0/1002625842 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3df0002ae0 con 0x7f3e08115410 2026-02-13T02:46:24.712 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.708+0000 7f3dfdffb6c0 1 -- 10.20.193.78:0/1002625842 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3df002fd10 con 0x7f3e08115410 2026-02-13T02:46:24.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.708+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e080fad70 con 0x7f3e08115410 2026-02-13T02:46:24.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.708+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e080fb1f0 con 0x7f3e08115410 2026-02-13T02:46:24.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.708+0000 7f3dfdffb6c0 1 -- 10.20.193.78:0/1002625842 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3df0031030 con 0x7f3e08115410 2026-02-13T02:46:24.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.708+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e081104d0 con 0x7f3e08115410 2026-02-13T02:46:24.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.711+0000 7f3dfdffb6c0 1 -- 10.20.193.78:0/1002625842 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f3df00071c0 con 0x7f3e08115410 2026-02-13T02:46:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.712+0000 7f3dfdffb6c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3de40b5650 0x7f3de40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.712+0000 7f3dfdffb6c0 1 -- 10.20.193.78:0/1002625842 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f3df0107ba0 con 0x7f3e08115410 2026-02-13T02:46:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.712+0000 7f3e0ce7a6c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3de40b5650 0x7f3de40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:24.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.712+0000 7f3dfdffb6c0 1 -- 10.20.193.78:0/1002625842 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3df0140600 con 0x7f3e08115410 2026-02-13T02:46:24.715 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.713+0000 7f3e0ce7a6c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3de40b5650 0x7f3de40d5b00 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df8005b40 tx=0x7f3df8009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:24.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.836+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3e0810f5d0 con 0x7f3e08115410 2026-02-13T02:46:24.838 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.836+0000 7f3dfdffb6c0 1 -- 10.20.193.78:0/1002625842 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3df00ca4c0 con 0x7f3e08115410 2026-02-13T02:46:24.838 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:24.839 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:24.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3de40b5650 msgr2=0x7f3de40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:24.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3de40b5650 0x7f3de40d5b00 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df8005b40 tx=0x7f3df8009310 comp rx=0 tx=0).stop 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 msgr2=0x7f3e08175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 0x7f3e08175cb0 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df00097f0 tx=0x7f3df0005540 comp rx=0 tx=0).stop 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 shutdown_connections 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f3de40b5650 0x7f3de40d5b00 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3e080f5120 0x7f3e080fa3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3e08115410 0x7f3e08175cb0 unknown :-1 s=CLOSED pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 --2- 10.20.193.78:0/1002625842 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3e0810f200 0x7f3e080f4af0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 >> 10.20.193.78:0/1002625842 conn(0x7f3e080ecb00 msgr2=0x7f3e0810d720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.837+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 shutdown_connections 2026-02-13T02:46:24.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:24.838+0000 7f3e0f1096c0 1 -- 10.20.193.78:0/1002625842 wait complete. 2026-02-13T02:46:25.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:25 trial078 ceph-mon[22944]: pgmap v324: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:25.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:25 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1002625842' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:26.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:25 trial154 ceph-mon[27921]: pgmap v324: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:26.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:25 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1002625842' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:25 trial091 ceph-mon[27614]: pgmap v324: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:26.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:25 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1002625842' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:27.940 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:27.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:27 trial078 ceph-mon[22944]: pgmap v325: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:28.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:27 trial154 ceph-mon[27921]: pgmap v325: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:28.125 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:28.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:27 trial091 ceph-mon[27614]: pgmap v325: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:28.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 -- 10.20.193.78:0/2654776426 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc10fa50 msgr2=0x7f21cc114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:28.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/2654776426 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc10fa50 0x7f21cc114a90 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=2465189047160159177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21c00099a0 tx=0x7f21c002ed20 comp rx=0 tx=0).stop 2026-02-13T02:46:28.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 -- 10.20.193.78:0/2654776426 shutdown_connections 2026-02-13T02:46:28.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/2654776426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21cc115270 0x7f21cc175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/2654776426 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc10fa50 0x7f21cc114a90 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=2465189047160159177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/2654776426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21cc10f060 0x7f21cc10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.313 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 -- 10.20.193.78:0/2654776426 >> 10.20.193.78:0/2654776426 conn(0x7f21cc0ec980 msgr2=0x7f21cc10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:28.314 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 -- 10.20.193.78:0/2654776426 shutdown_connections 2026-02-13T02:46:28.315 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.311+0000 7f21d22a36c0 1 -- 10.20.193.78:0/2654776426 wait complete. 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.312+0000 7f21d22a36c0 1 Processor -- start 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.312+0000 7f21d22a36c0 1 -- start start 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d22a36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21cc10f060 0x7f21cc0f4a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d22a36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21cc115270 0x7f21cc175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d22a36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc0f5040 0x7f21cc0fa310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d22a36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc0f56a0 con 0x7f21cc0f5040 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d22a36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc0fa850 con 0x7f21cc10f060 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d22a36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc0faa10 con 0x7f21cc115270 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc0f5040 0x7f21cc0fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc0f5040 0x7f21cc0fa310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:37226/0 (socket says 10.20.193.78:37226) 2026-02-13T02:46:28.316 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 -- 10.20.193.78:0/359608098 learned_addr learned my addr 10.20.193.78:0/359608098 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d0aa06c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21cc115270 0x7f21cc175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d12a16c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21cc10f060 0x7f21cc0f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 -- 10.20.193.78:0/359608098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21cc115270 msgr2=0x7f21cc175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21cc115270 0x7f21cc175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 -- 10.20.193.78:0/359608098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21cc10f060 msgr2=0x7f21cc0f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21cc10f060 0x7f21cc0f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 -- 10.20.193.78:0/359608098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c0009590 con 0x7f21cc0f5040 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21d1aa26c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc0f5040 0x7f21cc0fa310 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21c8006ea0 tx=0x7f21c800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.313+0000 7f21ba7fc6c0 1 -- 10.20.193.78:0/359608098 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21c8003a30 con 0x7f21cc0f5040 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.314+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc0fac90 con 0x7f21cc0f5040 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.314+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21cc0fb170 con 0x7f21cc0f5040 2026-02-13T02:46:28.317 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.314+0000 7f21ba7fc6c0 1 -- 10.20.193.78:0/359608098 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f21c8005510 con 0x7f21cc0f5040 2026-02-13T02:46:28.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.314+0000 7f21ba7fc6c0 1 -- 10.20.193.78:0/359608098 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21c8003a30 con 0x7f21cc0f5040 2026-02-13T02:46:28.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.314+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21cc110330 con 0x7f21cc0f5040 2026-02-13T02:46:28.318 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.317+0000 7f21ba7fc6c0 1 -- 10.20.193.78:0/359608098 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f21c800db80 con 0x7f21cc0f5040 2026-02-13T02:46:28.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.318+0000 7f21ba7fc6c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21a80b5730 0x7f21a80d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:28.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.318+0000 7f21ba7fc6c0 1 -- 10.20.193.78:0/359608098 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f21c80e4970 con 0x7f21cc0f5040 2026-02-13T02:46:28.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.318+0000 7f21d12a16c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21a80b5730 0x7f21a80d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:28.320 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.319+0000 7f21d12a16c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21a80b5730 0x7f21a80d5be0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21bc004750 tx=0x7f21bc009f00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:28.321 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.319+0000 7f21ba7fc6c0 1 -- 10.20.193.78:0/359608098 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f21c80a7290 con 0x7f21cc0f5040 2026-02-13T02:46:28.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.442+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21cc10f430 con 0x7f21cc0f5040 2026-02-13T02:46:28.444 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.443+0000 7f21ba7fc6c0 1 -- 10.20.193.78:0/359608098 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f21c800de60 con 0x7f21cc0f5040 2026-02-13T02:46:28.445 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:28.445 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21a80b5730 msgr2=0x7f21a80d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21a80b5730 0x7f21a80d5be0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21bc004750 tx=0x7f21bc009f00 comp rx=0 tx=0).stop 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc0f5040 msgr2=0x7f21cc0fa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc0f5040 0x7f21cc0fa310 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21c8006ea0 tx=0x7f21c800cca0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 shutdown_connections 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21a80b5730 0x7f21a80d5be0 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21cc0f5040 0x7f21cc0fa310 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.446 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21cc115270 0x7f21cc175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 --2- 10.20.193.78:0/359608098 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21cc10f060 0x7f21cc0f4a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:28.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 >> 10.20.193.78:0/359608098 conn(0x7f21cc0ec980 msgr2=0x7f21cc10d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:28.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 shutdown_connections 2026-02-13T02:46:28.447 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:28.444+0000 7f21d22a36c0 1 -- 10.20.193.78:0/359608098 wait complete. 2026-02-13T02:46:28.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:28 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/359608098' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:29.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:28 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/359608098' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:29.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:28 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/359608098' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:29.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:29 trial078 ceph-mon[22944]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:30.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:29 trial154 ceph-mon[27921]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:30.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:29 trial091 ceph-mon[27614]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:31.548 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:31.732 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:31.861 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:31 trial078 ceph-mon[22944]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:31.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 -- 10.20.193.78:0/2780682748 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3d0115270 msgr2=0x7fb3d0175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:31.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/2780682748 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3d0115270 0x7fb3d0175c10 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=4819681268570334717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3cc00a9b0 tx=0x7fb3cc02fd20 comp rx=0 tx=0).stop 2026-02-13T02:46:31.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 -- 10.20.193.78:0/2780682748 shutdown_connections 2026-02-13T02:46:31.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/2780682748 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3d0115270 0x7fb3d0175c10 unknown :-1 s=CLOSED pgs=142 gs=2 cs=0 l=1 c_cookie=4819681268570334717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:31.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/2780682748 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3d010fa50 0x7fb3d0114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:31.923 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/2780682748 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d010f060 0x7fb3d010f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 -- 10.20.193.78:0/2780682748 >> 10.20.193.78:0/2780682748 conn(0x7fb3d00ec980 msgr2=0x7fb3d010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 -- 10.20.193.78:0/2780682748 shutdown_connections 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.922+0000 7fb3d59536c0 1 -- 10.20.193.78:0/2780682748 wait complete. 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 Processor -- start 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 -- start start 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3d010f060 0x7fb3d011cf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d0115270 0x7fb3d011d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3d0122890 0x7fb3d0122d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d01232a0 con 0x7fb3d0115270 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d0123410 con 0x7fb3d0122890 2026-02-13T02:46:31.924 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3d59536c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d01235d0 con 0x7fb3d010f060 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3c7fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d0115270 0x7fb3d011d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3c7fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d0115270 0x7fb3d011d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:37244/0 (socket says 10.20.193.78:37244) 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3c7fff6c0 1 -- 10.20.193.78:0/935171436 learned_addr learned my addr 10.20.193.78:0/935171436 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3c7fff6c0 1 -- 10.20.193.78:0/935171436 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3d010f060 msgr2=0x7fb3d011cf90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3c7fff6c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3d010f060 0x7fb3d011cf90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.923+0000 7fb3c7fff6c0 1 -- 10.20.193.78:0/935171436 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3d0122890 msgr2=0x7fb3d0122d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3c7fff6c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3d0122890 0x7fb3d0122d30 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3c7fff6c0 1 -- 10.20.193.78:0/935171436 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c0009590 con 0x7fb3d0115270 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3c7fff6c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d0115270 0x7fb3d011d4d0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3b800b750 tx=0x7fb3b800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3c5ffb6c0 1 -- 10.20.193.78:0/935171436 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3b8004a80 con 0x7fb3d0115270 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3c5ffb6c0 1 -- 10.20.193.78:0/935171436 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb3b8009030 con 0x7fb3d0115270 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3c5ffb6c0 1 -- 10.20.193.78:0/935171436 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3b800cdd0 con 0x7fb3d0115270 2026-02-13T02:46:31.925 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3cc00a5b0 con 0x7fb3d0115270 2026-02-13T02:46:31.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.924+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d0163d80 con 0x7fb3d0115270 2026-02-13T02:46:31.926 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.925+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d0110330 con 0x7fb3d0115270 2026-02-13T02:46:31.928 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.927+0000 7fb3c5ffb6c0 1 -- 10.20.193.78:0/935171436 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb3b80026b0 con 0x7fb3d0115270 2026-02-13T02:46:31.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.929+0000 7fb3c5ffb6c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb3ac0b56d0 0x7fb3ac0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:31.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.929+0000 7fb3c5ffb6c0 1 -- 10.20.193.78:0/935171436 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fb3b80e3c00 con 0x7fb3d0115270 2026-02-13T02:46:31.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.929+0000 7fb3d49516c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb3ac0b56d0 0x7fb3ac0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:31.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.929+0000 7fb3c5ffb6c0 1 -- 10.20.193.78:0/935171436 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3b811c660 con 0x7fb3d0115270 2026-02-13T02:46:31.930 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:31.929+0000 7fb3d49516c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb3ac0b56d0 0x7fb3ac0d5b80 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3c0004750 tx=0x7fb3c0009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:32.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:31 trial154 ceph-mon[27921]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:32.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.052+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb3d010f430 con 0x7fb3d0115270 2026-02-13T02:46:32.054 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.052+0000 7fb3c5ffb6c0 1 -- 10.20.193.78:0/935171436 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb3b80a6520 con 0x7fb3d0115270 2026-02-13T02:46:32.054 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:32.054 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:32.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb3ac0b56d0 msgr2=0x7fb3ac0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:32.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb3ac0b56d0 0x7fb3ac0d5b80 secure :-1 s=READY pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3c0004750 tx=0x7fb3c0009310 comp rx=0 tx=0).stop 2026-02-13T02:46:32.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d0115270 msgr2=0x7fb3d011d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:32.055 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d0115270 0x7fb3d011d4d0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3b800b750 tx=0x7fb3b800bc20 comp rx=0 tx=0).stop 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 shutdown_connections 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fb3ac0b56d0 0x7fb3ac0d5b80 unknown :-1 s=CLOSED pgs=258 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3d0122890 0x7fb3d0122d30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb3d0115270 0x7fb3d011d4d0 unknown :-1 s=CLOSED pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 --2- 10.20.193.78:0/935171436 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3d010f060 0x7fb3d011cf90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 >> 10.20.193.78:0/935171436 conn(0x7fb3d00ec980 msgr2=0x7fb3d010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.053+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 shutdown_connections 2026-02-13T02:46:32.056 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:32.054+0000 7fb3d59536c0 1 -- 10.20.193.78:0/935171436 wait complete. 2026-02-13T02:46:32.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:31 trial091 ceph-mon[27614]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:32.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:32 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/935171436' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:33.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:32 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/935171436' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:33.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:32 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/935171436' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:33.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:33 trial078 ceph-mon[22944]: pgmap v328: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:34.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:33 trial154 ceph-mon[27921]: pgmap v328: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:34.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:33 trial091 ceph-mon[27614]: pgmap v328: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:35.159 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:35.344 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 -- 10.20.193.78:0/3088968571 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 msgr2=0x7fa60410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:35.552 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/3088968571 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60410f430 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=9481383480943910156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f80099a0 tx=0x7fa5f802ed00 comp rx=0 tx=0).stop 2026-02-13T02:46:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 -- 10.20.193.78:0/3088968571 shutdown_connections 2026-02-13T02:46:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/3088968571 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa604115270 0x7fa604175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/3088968571 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa60410fa50 0x7fa604114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/3088968571 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60410f430 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=9481383480943910156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 -- 10.20.193.78:0/3088968571 >> 10.20.193.78:0/3088968571 conn(0x7fa6040ec980 msgr2=0x7fa60410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 -- 10.20.193.78:0/3088968571 shutdown_connections 2026-02-13T02:46:35.553 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.550+0000 7fa603fff6c0 1 -- 10.20.193.78:0/3088968571 wait complete. 2026-02-13T02:46:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.551+0000 7fa603fff6c0 1 Processor -- start 2026-02-13T02:46:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.551+0000 7fa603fff6c0 1 -- start start 2026-02-13T02:46:35.555 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa603fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60411cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa603fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa604115270 0x7fa60411d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa603fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa604122830 0x7fa604122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa603fff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa604123240 con 0x7fa60410f060 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa603fff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa6041233b0 con 0x7fa604122830 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa603fff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa604123570 con 0x7fa604115270 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60411cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60411cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:37272/0 (socket says 10.20.193.78:37272) 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 -- 10.20.193.78:0/2210035194 learned_addr learned my addr 10.20.193.78:0/2210035194 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa6037fe6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa604122830 0x7fa604122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa6027fc6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa604115270 0x7fa60411d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:35.556 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 -- 10.20.193.78:0/2210035194 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa604115270 msgr2=0x7fa60411d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa604115270 0x7fa60411d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 -- 10.20.193.78:0/2210035194 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa604122830 msgr2=0x7fa604122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa604122830 0x7fa604122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 -- 10.20.193.78:0/2210035194 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f8009590 con 0x7fa60410f060 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa6027fc6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa604115270 0x7fa60411d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.552+0000 7fa602ffd6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60411cf30 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f8031fd0 tx=0x7fa5f802fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.553+0000 7fa5e3fff6c0 1 -- 10.20.193.78:0/2210035194 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5f8002ae0 con 0x7fa60410f060 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.553+0000 7fa5e3fff6c0 1 -- 10.20.193.78:0/2210035194 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa5f80046b0 con 0x7fa60410f060 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.553+0000 7fa5e3fff6c0 1 -- 10.20.193.78:0/2210035194 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5f80372f0 con 0x7fa60410f060 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.553+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6041639c0 con 0x7fa60410f060 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.553+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa604163df0 con 0x7fa60410f060 2026-02-13T02:46:35.557 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.553+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa604110330 con 0x7fa60410f060 2026-02-13T02:46:35.558 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.555+0000 7fa5e3fff6c0 1 -- 10.20.193.78:0/2210035194 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa5f80077d0 con 0x7fa60410f060 2026-02-13T02:46:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.557+0000 7fa5e3fff6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5d80b56d0 0x7fa5d80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.557+0000 7fa5e3fff6c0 1 -- 10.20.193.78:0/2210035194 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7fa5f8107e20 con 0x7fa60410f060 2026-02-13T02:46:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.557+0000 7fa5e3fff6c0 1 -- 10.20.193.78:0/2210035194 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa5f81082a0 con 0x7fa60410f060 2026-02-13T02:46:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.557+0000 7fa6027fc6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5d80b56d0 0x7fa5d80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:35.559 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.558+0000 7fa6027fc6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5d80b56d0 0x7fa5d80d5b80 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6041238c0 tx=0x7fa5ec009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.682+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa60410f430 con 0x7fa60410f060 2026-02-13T02:46:35.683 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.682+0000 7fa5e3fff6c0 1 -- 10.20.193.78:0/2210035194 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa5f80ca740 con 0x7fa60410f060 2026-02-13T02:46:35.683 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:35.683 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5d80b56d0 msgr2=0x7fa5d80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5d80b56d0 0x7fa5d80d5b80 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6041238c0 tx=0x7fa5ec009260 comp rx=0 tx=0).stop 2026-02-13T02:46:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 msgr2=0x7fa60411cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60411cf30 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5f8031fd0 tx=0x7fa5f802fc60 comp rx=0 tx=0).stop 2026-02-13T02:46:35.684 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 shutdown_connections 2026-02-13T02:46:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7fa5d80b56d0 0x7fa5d80d5b80 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa604122830 0x7fa604122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa604115270 0x7fa60411d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 --2- 10.20.193.78:0/2210035194 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa60410f060 0x7fa60411cf30 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 >> 10.20.193.78:0/2210035194 conn(0x7fa6040ec980 msgr2=0x7fa60410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 shutdown_connections 2026-02-13T02:46:35.685 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:35.683+0000 7fa603fff6c0 1 -- 10.20.193.78:0/2210035194 wait complete. 2026-02-13T02:46:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:35 trial078 ceph-mon[22944]: pgmap v329: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:35.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:35 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/2210035194' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:36.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:35 trial154 ceph-mon[27921]: pgmap v329: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:36.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:35 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/2210035194' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:36.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:35 trial091 ceph-mon[27614]: pgmap v329: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:36.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:35 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/2210035194' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:37.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:37 trial078 ceph-mon[22944]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:38.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:37 trial154 ceph-mon[27921]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:38.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:37 trial091 ceph-mon[27614]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:38.787 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:38.972 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:39.160 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.158+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/3800975763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 msgr2=0x7f1944175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.158+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/3800975763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 0x7f1944175c10 secure :-1 s=READY pgs=280 gs=2 cs=0 l=1 c_cookie=6323423953928793172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f194000aa70 tx=0x7f194002fde0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.158+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/3800975763 shutdown_connections 2026-02-13T02:46:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.158+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/3800975763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 0x7f1944175c10 unknown :-1 s=CLOSED pgs=280 gs=2 cs=0 l=1 c_cookie=6323423953928793172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.158+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/3800975763 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f194410fa50 0x7f1944114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.158+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/3800975763 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f194410f060 0x7f194410f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.158+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/3800975763 >> 10.20.193.78:0/3800975763 conn(0x7f19440ec980 msgr2=0x7f194410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:39.161 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.159+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/3800975763 shutdown_connections 2026-02-13T02:46:39.162 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.159+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/3800975763 wait complete. 2026-02-13T02:46:39.163 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.159+0000 7f194b4ff6c0 1 Processor -- start 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.159+0000 7f194b4ff6c0 1 -- start start 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.159+0000 7f194b4ff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f194410f060 0x7f194411cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.159+0000 7f194b4ff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 0x7f194411d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.159+0000 7f194b4ff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1944122860 0x7f1944122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194b4ff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1944123270 con 0x7f1944115270 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194b4ff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f19441233e0 con 0x7f194410f060 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194b4ff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19441235a0 con 0x7f1944122860 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194a4fd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f194410f060 0x7f194411cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:39.164 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f1949cfc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 0x7f194411d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194a4fd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f194410f060 0x7f194411cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:43134/0 (socket says 10.20.193.78:43134) 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194a4fd6c0 1 -- 10.20.193.78:0/1600881874 learned_addr learned my addr 10.20.193.78:0/1600881874 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194acfe6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1944122860 0x7f1944122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f1949cfc6c0 1 -- 10.20.193.78:0/1600881874 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1944122860 msgr2=0x7f1944122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f1949cfc6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1944122860 0x7f1944122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f1949cfc6c0 1 -- 10.20.193.78:0/1600881874 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f194410f060 msgr2=0x7f194411cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f1949cfc6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f194410f060 0x7f194411cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f1949cfc6c0 1 -- 10.20.193.78:0/1600881874 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194000a660 con 0x7f1944115270 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f1949cfc6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 0x7f194411d4a0 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1938004750 tx=0x7f193800bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f192b7fe6c0 1 -- 10.20.193.78:0/1600881874 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19380044a0 con 0x7f1944115270 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f192b7fe6c0 1 -- 10.20.193.78:0/1600881874 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1938009030 con 0x7f1944115270 2026-02-13T02:46:39.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f192b7fe6c0 1 -- 10.20.193.78:0/1600881874 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f193800ccb0 con 0x7f1944115270 2026-02-13T02:46:39.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.160+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1944163a50 con 0x7f1944115270 2026-02-13T02:46:39.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.161+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1944163ee0 con 0x7f1944115270 2026-02-13T02:46:39.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.162+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1944110330 con 0x7f1944115270 2026-02-13T02:46:39.166 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.163+0000 7f192b7fe6c0 1 -- 10.20.193.78:0/1600881874 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f19380026b0 con 0x7f1944115270 2026-02-13T02:46:39.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.165+0000 7f192b7fe6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f19200b56d0 0x7f19200d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:39.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.165+0000 7f192b7fe6c0 1 -- 10.20.193.78:0/1600881874 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f19380e3b60 con 0x7f1944115270 2026-02-13T02:46:39.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.165+0000 7f194a4fd6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f19200b56d0 0x7f19200d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:39.167 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.165+0000 7f194a4fd6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f19200b56d0 0x7f19200d5b80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1934009240 tx=0x7f1934009420 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:39.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.165+0000 7f192b7fe6c0 1 -- 10.20.193.78:0/1600881874 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f19380a64c0 con 0x7f1944115270 2026-02-13T02:46:39.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.289+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f194411e0b0 con 0x7f1944115270 2026-02-13T02:46:39.291 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.289+0000 7f192b7fe6c0 1 -- 10.20.193.78:0/1600881874 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f19380a9670 con 0x7f1944115270 2026-02-13T02:46:39.291 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:39.291 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f19200b56d0 msgr2=0x7f19200d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f19200b56d0 0x7f19200d5b80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1934009240 tx=0x7f1934009420 comp rx=0 tx=0).stop 2026-02-13T02:46:39.292 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 msgr2=0x7f194411d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 0x7f194411d4a0 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1938004750 tx=0x7f193800bae0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 shutdown_connections 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f19200b56d0 0x7f19200d5b80 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1944122860 0x7f1944122d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1944115270 0x7f194411d4a0 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 --2- 10.20.193.78:0/1600881874 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f194410f060 0x7f194411cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 >> 10.20.193.78:0/1600881874 conn(0x7f19440ec980 msgr2=0x7f194410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 shutdown_connections 2026-02-13T02:46:39.293 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:39.290+0000 7f194b4ff6c0 1 -- 10.20.193.78:0/1600881874 wait complete. 2026-02-13T02:46:39.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:39 trial078 ceph-mon[22944]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:39.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:39 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1600881874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:40.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:39 trial154 ceph-mon[27921]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:40.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:39 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1600881874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:40.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:39 trial091 ceph-mon[27614]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:40.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:39 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1600881874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:41.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:41 trial078 ceph-mon[22944]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:41.997 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:41 trial091 ceph-mon[27614]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:42.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:41 trial154 ceph-mon[27921]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:42.394 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:42.581 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:42.779 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/1631259392 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e2010fbf0 msgr2=0x7f4e20114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/1631259392 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e2010fbf0 0x7f4e20114c30 secure :-1 s=READY pgs=282 gs=2 cs=0 l=1 c_cookie=8630756459793053527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e100099a0 tx=0x7f4e1002ed00 comp rx=0 tx=0).stop 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/1631259392 shutdown_connections 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/1631259392 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e20115410 0x7f4e20175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/1631259392 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e2010fbf0 0x7f4e20114c30 unknown :-1 s=CLOSED pgs=282 gs=2 cs=0 l=1 c_cookie=8630756459793053527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/1631259392 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 0x7f4e2010f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/1631259392 >> 10.20.193.78:0/1631259392 conn(0x7f4e200ecb00 msgr2=0x7f4e2010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/1631259392 shutdown_connections 2026-02-13T02:46:42.780 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.777+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/1631259392 wait complete. 2026-02-13T02:46:42.781 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 Processor -- start 2026-02-13T02:46:42.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 -- start start 2026-02-13T02:46:42.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 0x7f4e200f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:42.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e20115410 0x7f4e20175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:42.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e200f5120 0x7f4e200fa3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:42.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4e200f5810 con 0x7f4e200f5120 2026-02-13T02:46:42.782 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4e200fa930 con 0x7f4e20115410 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.778+0000 7f4e25dcc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e200faaf0 con 0x7f4e2010f200 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 0x7f4e200f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 0x7f4e200f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.78:34402/0 (socket says 10.20.193.78:34402) 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 -- 10.20.193.78:0/448862826 learned_addr learned my addr 10.20.193.78:0/448862826 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1effd6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e20115410 0x7f4e20175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1ffff6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e200f5120 0x7f4e200fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 -- 10.20.193.78:0/448862826 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e20115410 msgr2=0x7f4e20175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e20115410 0x7f4e20175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 -- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e200f5120 msgr2=0x7f4e200fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e200f5120 0x7f4e200fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 -- 10.20.193.78:0/448862826 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e10009590 con 0x7f4e2010f200 2026-02-13T02:46:42.783 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1ffff6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e200f5120 0x7f4e200fa3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:46:42.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1f7fe6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 0x7f4e200f4af0 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e0c00b7b0 tx=0x7f4e0c00bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:42.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1cff96c0 1 -- 10.20.193.78:0/448862826 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e0c004a80 con 0x7f4e2010f200 2026-02-13T02:46:42.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1cff96c0 1 -- 10.20.193.78:0/448862826 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4e0c009030 con 0x7f4e2010f200 2026-02-13T02:46:42.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e200fadd0 con 0x7f4e2010f200 2026-02-13T02:46:42.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e1cff96c0 1 -- 10.20.193.78:0/448862826 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e0c00ce30 con 0x7f4e2010f200 2026-02-13T02:46:42.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.779+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e200fb260 con 0x7f4e2010f200 2026-02-13T02:46:42.784 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.780+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e201104d0 con 0x7f4e2010f200 2026-02-13T02:46:42.785 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.782+0000 7f4e1cff96c0 1 -- 10.20.193.78:0/448862826 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4e0c005020 con 0x7f4e2010f200 2026-02-13T02:46:42.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.784+0000 7f4e1cff96c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4df40b5650 0x7f4df40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:42.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.784+0000 7f4e1cff96c0 1 -- 10.20.193.78:0/448862826 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f4e0c0e3af0 con 0x7f4e2010f200 2026-02-13T02:46:42.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.784+0000 7f4e1cff96c0 1 -- 10.20.193.78:0/448862826 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4e0c11c5e0 con 0x7f4e2010f200 2026-02-13T02:46:42.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.784+0000 7f4e1effd6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4df40b5650 0x7f4df40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:42.786 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.785+0000 7f4e1effd6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4df40b5650 0x7f4df40d5b00 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e200fb480 tx=0x7f4e100023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:42.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.908+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4e200fb260 con 0x7f4e2010f200 2026-02-13T02:46:42.910 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.908+0000 7f4e1cff96c0 1 -- 10.20.193.78:0/448862826 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4e200fb260 con 0x7f4e2010f200 2026-02-13T02:46:42.911 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:42.911 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.909+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4df40b5650 msgr2=0x7f4df40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4df40b5650 0x7f4df40d5b00 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e200fb480 tx=0x7f4e100023a0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 msgr2=0x7f4e200f4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 0x7f4e200f4af0 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e0c00b7b0 tx=0x7f4e0c00bc80 comp rx=0 tx=0).stop 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 shutdown_connections 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f4df40b5650 0x7f4df40d5b00 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4e200f5120 0x7f4e200fa3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e20115410 0x7f4e20175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.912 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 --2- 10.20.193.78:0/448862826 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2010f200 0x7f4e200f4af0 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:42.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 >> 10.20.193.78:0/448862826 conn(0x7f4e200ecb00 msgr2=0x7f4e2010d720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:42.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 shutdown_connections 2026-02-13T02:46:42.913 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:42.910+0000 7f4e25dcc6c0 1 -- 10.20.193.78:0/448862826 wait complete. 2026-02-13T02:46:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:43 trial154 ceph-mon[27921]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:44.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:43 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/448862826' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:43 trial091 ceph-mon[27614]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:44.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:43 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/448862826' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:43 trial078 ceph-mon[22944]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:44.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:43 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/448862826' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:46.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:45 trial154 ceph-mon[27921]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:46.018 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:46.069 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:45 trial078 ceph-mon[22944]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:46.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:45 trial091 ceph-mon[27614]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:46.199 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:46.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.391+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1937686170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 msgr2=0x7f30b4175c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:46.395 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.391+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1937686170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175c00 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=7985010087272871701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30b000aa70 tx=0x7f30b002fde0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1937686170 shutdown_connections 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1937686170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175c00 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=7985010087272871701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1937686170 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30b410fa40 0x7f30b4114a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1937686170 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30b410f050 0x7f30b410f420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1937686170 >> 10.20.193.78:0/1937686170 conn(0x7f30b40ec950 msgr2=0x7f30b410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1937686170 shutdown_connections 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1937686170 wait complete. 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.392+0000 7f30ba2136c0 1 Processor -- start 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30ba2136c0 1 -- start start 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30ba2136c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30b410f050 0x7f30b40f4900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:46.396 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30ba2136c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30ba2136c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30b40f4f30 0x7f30b40fa1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30ba2136c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40f5620 con 0x7f30b4115260 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30ba2136c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40fa6f0 con 0x7f30b40f4f30 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30ba2136c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40fa8b0 con 0x7f30b410f050 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:33738/0 (socket says 10.20.193.78:33738) 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 -- 10.20.193.78:0/1187865319 learned_addr learned my addr 10.20.193.78:0/1187865319 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b9a126c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30b40f4f30 0x7f30b40fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 -- 10.20.193.78:0/1187865319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30b410f050 msgr2=0x7f30b40f4900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30b410f050 0x7f30b40f4900 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 -- 10.20.193.78:0/1187865319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30b40f4f30 msgr2=0x7f30b40fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:46.397 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30b40f4f30 0x7f30b40fa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 -- 10.20.193.78:0/1187865319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b000a660 con 0x7f30b4115260 2026-02-13T02:46:46.398 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.393+0000 7f30b8a106c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175b00 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30a800b750 tx=0x7f30a800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:46.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.394+0000 7f30a27fc6c0 1 -- 10.20.193.78:0/1187865319 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30a8004a80 con 0x7f30b4115260 2026-02-13T02:46:46.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.394+0000 7f30a27fc6c0 1 -- 10.20.193.78:0/1187865319 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f30a8009030 con 0x7f30b4115260 2026-02-13T02:46:46.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.394+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b40fab90 con 0x7f30b4115260 2026-02-13T02:46:46.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.394+0000 7f30a27fc6c0 1 -- 10.20.193.78:0/1187865319 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30a800cdd0 con 0x7f30b4115260 2026-02-13T02:46:46.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.394+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b40fb320 con 0x7f30b4115260 2026-02-13T02:46:46.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.394+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b4110320 con 0x7f30b4115260 2026-02-13T02:46:46.399 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.397+0000 7f30a27fc6c0 1 -- 10.20.193.78:0/1187865319 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f30a8004f20 con 0x7f30b4115260 2026-02-13T02:46:46.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.398+0000 7f30a27fc6c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f30900b57a0 0x7f30900d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:46.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.399+0000 7f30b92116c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f30900b57a0 0x7f30900d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:46.400 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.399+0000 7f30a27fc6c0 1 -- 10.20.193.78:0/1187865319 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f30a80e3b30 con 0x7f30b4115260 2026-02-13T02:46:46.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.399+0000 7f30a27fc6c0 1 -- 10.20.193.78:0/1187865319 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f30a80a9ef0 con 0x7f30b4115260 2026-02-13T02:46:46.401 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.399+0000 7f30b92116c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f30900b57a0 0x7f30900d5c50 secure :-1 s=READY pgs=262 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30a4004750 tx=0x7f30a4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:46.524 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.523+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f30b40f5a00 con 0x7f30b4115260 2026-02-13T02:46:46.525 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.523+0000 7f30a27fc6c0 1 -- 10.20.193.78:0/1187865319 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f30a8070500 con 0x7f30b4115260 2026-02-13T02:46:46.525 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:46.525 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:46.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f30900b57a0 msgr2=0x7f30900d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:46.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f30900b57a0 0x7f30900d5c50 secure :-1 s=READY pgs=262 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30a4004750 tx=0x7f30a4009260 comp rx=0 tx=0).stop 2026-02-13T02:46:46.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 msgr2=0x7f30b4175b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:46.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175b00 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30a800b750 tx=0x7f30a800bc20 comp rx=0 tx=0).stop 2026-02-13T02:46:46.526 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 shutdown_connections 2026-02-13T02:46:46.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f30900b57a0 0x7f30900d5c50 unknown :-1 s=CLOSED pgs=262 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30b40f4f30 0x7f30b40fa1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f30b4115260 0x7f30b4175b00 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 --2- 10.20.193.78:0/1187865319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30b410f050 0x7f30b40f4900 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:46.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 >> 10.20.193.78:0/1187865319 conn(0x7f30b40ec950 msgr2=0x7f30b410d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:46.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 shutdown_connections 2026-02-13T02:46:46.527 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:46.524+0000 7f30ba2136c0 1 -- 10.20.193.78:0/1187865319 wait complete. 2026-02-13T02:46:46.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:46 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1187865319' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:47.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:46 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1187865319' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:47.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:46 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1187865319' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:48.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:47 trial154 ceph-mon[27921]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:48.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:47 trial091 ceph-mon[27614]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:48.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:47 trial078 ceph-mon[22944]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:49.630 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:49.816 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:49.946 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:49 trial078 ceph-mon[22944]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:50.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:49 trial154 ceph-mon[27921]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:50.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 -- 10.20.193.78:0/102609983 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10fbf0 msgr2=0x7f345c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:50.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 --2- 10.20.193.78:0/102609983 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10fbf0 0x7f345c114c30 secure :-1 s=READY pgs=144 gs=1 cs=0 l=1 c_cookie=11110380470271556625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34500099a0 tx=0x7f345002ed00 comp rx=0 tx=0).stop 2026-02-13T02:46:50.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 -- 10.20.193.78:0/102609983 shutdown_connections 2026-02-13T02:46:50.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 --2- 10.20.193.78:0/102609983 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 0x7f345c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 --2- 10.20.193.78:0/102609983 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10fbf0 0x7f345c114c30 unknown :-1 s=CLOSED pgs=144 gs=1 cs=0 l=1 c_cookie=11110380470271556625 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 --2- 10.20.193.78:0/102609983 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f345c10f200 0x7f345c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.018 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 -- 10.20.193.78:0/102609983 >> 10.20.193.78:0/102609983 conn(0x7f345c0ecb00 msgr2=0x7f345c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 -- 10.20.193.78:0/102609983 shutdown_connections 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.014+0000 7f34633376c0 1 -- 10.20.193.78:0/102609983 wait complete. 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 Processor -- start 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 -- start start 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10f200 0x7f345c0f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 0x7f345c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f345c0f51f0 0x7f345c0fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0f58e0 con 0x7f345c115410 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0faa00 con 0x7f345c0f51f0 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34633376c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f345c0fabc0 con 0x7f345c10f200 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34608a76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 0x7f345c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:50.019 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34608a76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 0x7f345c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:33752/0 (socket says 10.20.193.78:33752) 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34608a76c0 1 -- 10.20.193.78:0/3097257035 learned_addr learned my addr 10.20.193.78:0/3097257035 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34610a86c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10f200 0x7f345c0f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34618a96c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f345c0f51f0 0x7f345c0fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34608a76c0 1 -- 10.20.193.78:0/3097257035 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10f200 msgr2=0x7f345c0f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.015+0000 7f34608a76c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10f200 0x7f345c0f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f34608a76c0 1 -- 10.20.193.78:0/3097257035 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f345c0f51f0 msgr2=0x7f345c0fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f34608a76c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f345c0f51f0 0x7f345c0fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f34608a76c0 1 -- 10.20.193.78:0/3097257035 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345800a5b0 con 0x7f345c115410 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f34608a76c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 0x7f345c175cb0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f345002f210 tx=0x7f345002fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:50.020 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f344a7fc6c0 1 -- 10.20.193.78:0/3097257035 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3450002ae0 con 0x7f345c115410 2026-02-13T02:46:50.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3450009590 con 0x7f345c115410 2026-02-13T02:46:50.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f344a7fc6c0 1 -- 10.20.193.78:0/3097257035 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f34500046b0 con 0x7f345c115410 2026-02-13T02:46:50.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f344a7fc6c0 1 -- 10.20.193.78:0/3097257035 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3450037520 con 0x7f345c115410 2026-02-13T02:46:50.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.016+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345c0fb180 con 0x7f345c115410 2026-02-13T02:46:50.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.017+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345c1104d0 con 0x7f345c115410 2026-02-13T02:46:50.021 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.019+0000 7f344a7fc6c0 1 -- 10.20.193.78:0/3097257035 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f3450002c80 con 0x7f345c115410 2026-02-13T02:46:50.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.021+0000 7f344a7fc6c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f34380b56d0 0x7f34380d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:50.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.021+0000 7f344a7fc6c0 1 -- 10.20.193.78:0/3097257035 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f3450107ce0 con 0x7f345c115410 2026-02-13T02:46:50.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.021+0000 7f34610a86c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f34380b56d0 0x7f34380d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:50.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.021+0000 7f344a7fc6c0 1 -- 10.20.193.78:0/3097257035 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3450108160 con 0x7f345c115410 2026-02-13T02:46:50.023 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.021+0000 7f34610a86c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f34380b56d0 0x7f34380d5b80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f344c004750 tx=0x7f344c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:50.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.146+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f345c0f5d10 con 0x7f345c115410 2026-02-13T02:46:50.148 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.146+0000 7f344a7fc6c0 1 -- 10.20.193.78:0/3097257035 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f34500ca600 con 0x7f345c115410 2026-02-13T02:46:50.148 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:50.148 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:50.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f34380b56d0 msgr2=0x7f34380d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:50.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f34380b56d0 0x7f34380d5b80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f344c004750 tx=0x7f344c009260 comp rx=0 tx=0).stop 2026-02-13T02:46:50.149 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 msgr2=0x7f345c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 0x7f345c175cb0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f345002f210 tx=0x7f345002fc60 comp rx=0 tx=0).stop 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 shutdown_connections 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f34380b56d0 0x7f34380d5b80 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f345c0f51f0 0x7f345c0fa4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f345c115410 0x7f345c175cb0 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 --2- 10.20.193.78:0/3097257035 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f345c10f200 0x7f345c0f4bc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.147+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 >> 10.20.193.78:0/3097257035 conn(0x7f345c0ecb00 msgr2=0x7f345c113bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.148+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 shutdown_connections 2026-02-13T02:46:50.150 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:50.148+0000 7f34633376c0 1 -- 10.20.193.78:0/3097257035 wait complete. 2026-02-13T02:46:50.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:49 trial091 ceph-mon[27614]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:51.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:50 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3097257035' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:51.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:50 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3097257035' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:51.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:50 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3097257035' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:52.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:51 trial154 ceph-mon[27921]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:52.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:51 trial091 ceph-mon[27614]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:52.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:51 trial078 ceph-mon[22944]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T02:46:53.252 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:53.435 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:53.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/1562601475 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc1137a0 msgr2=0x7f94dc113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:53.634 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/1562601475 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc1137a0 0x7f94dc113b70 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=235360859154624648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94d00099a0 tx=0x7f94d002ed00 comp rx=0 tx=0).stop 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/1562601475 shutdown_connections 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/1562601475 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc116520 0x7f94dc17a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/1562601475 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc114190 0x7f94dc115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/1562601475 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc1137a0 0x7f94dc113b70 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=235360859154624648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/1562601475 >> 10.20.193.78:0/1562601475 conn(0x7f94dc061510 msgr2=0x7f94dc061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/1562601475 shutdown_connections 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.630+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/1562601475 wait complete. 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 Processor -- start 2026-02-13T02:46:53.635 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 -- start start 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc1137a0 0x7f94dc1214e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc116520 0x7f94dc121a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc126de0 0x7f94dc127280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc1277f0 con 0x7f94dc126de0 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc127960 con 0x7f94dc1137a0 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.631+0000 7f94dbfff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc127b20 con 0x7f94dc116520 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc1137a0 0x7f94dc1214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc1137a0 0x7f94dc1214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.78:45174/0 (socket says 10.20.193.78:45174) 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 -- 10.20.193.78:0/3057492597 learned_addr learned my addr 10.20.193.78:0/3057492597 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:53.636 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94db7fe6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc126de0 0x7f94dc127280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94da7fc6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc116520 0x7f94dc121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 -- 10.20.193.78:0/3057492597 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc116520 msgr2=0x7f94dc121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc116520 0x7f94dc121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 -- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc126de0 msgr2=0x7f94dc127280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc126de0 0x7f94dc127280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 -- 10.20.193.78:0/3057492597 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d0009590 con 0x7f94dc1137a0 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94da7fc6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc116520 0x7f94dc121a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94daffd6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc1137a0 0x7f94dc1214e0 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94d0031fd0 tx=0x7f94d002fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94e08a66c0 1 -- 10.20.193.78:0/3057492597 <== mon.2 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94d0002ae0 con 0x7f94dc1137a0 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94e08a66c0 1 -- 10.20.193.78:0/3057492597 <== mon.2 v2:10.20.193.91:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f94d00046b0 con 0x7f94dc1137a0 2026-02-13T02:46:53.637 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94e08a66c0 1 -- 10.20.193.78:0/3057492597 <== mon.2 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94d00372f0 con 0x7f94dc1137a0 2026-02-13T02:46:53.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc167f70 con 0x7f94dc1137a0 2026-02-13T02:46:53.638 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.632+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc1683a0 con 0x7f94dc1137a0 2026-02-13T02:46:53.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.633+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94dc114840 con 0x7f94dc1137a0 2026-02-13T02:46:53.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.635+0000 7f94e08a66c0 1 -- 10.20.193.78:0/3057492597 <== mon.2 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f94d0002c40 con 0x7f94dc1137a0 2026-02-13T02:46:53.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.636+0000 7f94e08a66c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b00b56d0 0x7f94b00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:53.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.636+0000 7f94e08a66c0 1 -- 10.20.193.78:0/3057492597 <== mon.2 v2:10.20.193.91:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f94d0107c80 con 0x7f94dc1137a0 2026-02-13T02:46:53.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.637+0000 7f94e08a66c0 1 -- 10.20.193.78:0/3057492597 <== mon.2 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f94d0108100 con 0x7f94dc1137a0 2026-02-13T02:46:53.639 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.637+0000 7f94da7fc6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b00b56d0 0x7f94b00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:53.640 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.637+0000 7f94da7fc6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b00b56d0 0x7f94b00d5b80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94dc127e70 tx=0x7f94c4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:53.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.761+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f94dc113b70 con 0x7f94dc1137a0 2026-02-13T02:46:53.763 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.761+0000 7f94e08a66c0 1 -- 10.20.193.78:0/3057492597 <== mon.2 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f94d00ca5a0 con 0x7f94dc1137a0 2026-02-13T02:46:53.764 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:53.764 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b00b56d0 msgr2=0x7f94b00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b00b56d0 0x7f94b00d5b80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94dc127e70 tx=0x7f94c4009260 comp rx=0 tx=0).stop 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc1137a0 msgr2=0x7f94dc1214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc1137a0 0x7f94dc1214e0 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94d0031fd0 tx=0x7f94d002fc60 comp rx=0 tx=0).stop 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 shutdown_connections 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f94b00b56d0 0x7f94b00d5b80 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f94dc126de0 0x7f94dc127280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f94dc116520 0x7f94dc121a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.765 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 --2- 10.20.193.78:0/3057492597 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f94dc1137a0 0x7f94dc1214e0 unknown :-1 s=CLOSED pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:53.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 >> 10.20.193.78:0/3057492597 conn(0x7f94dc061510 msgr2=0x7f94dc116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:53.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 shutdown_connections 2026-02-13T02:46:53.766 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:53.763+0000 7f94dbfff6c0 1 -- 10.20.193.78:0/3057492597 wait complete. 2026-02-13T02:46:53.823 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:53 trial078 ceph-mon[22944]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:54.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:53 trial154 ceph-mon[27921]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:54.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:53 trial091 ceph-mon[27614]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:46:55.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:54 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3057492597' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:55.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:54 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3057492597' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:55.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:54 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3057492597' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:56.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:55 trial154 ceph-mon[27921]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:56.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:55 trial091 ceph-mon[27614]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:56.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:55 trial078 ceph-mon[22944]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 8 op/s 2026-02-13T02:46:56.865 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:46:57.050 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:46:57.240 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 -- 10.20.193.78:0/4164145974 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c41137a0 msgr2=0x7f09c4113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:57.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 --2- 10.20.193.78:0/4164145974 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c41137a0 0x7f09c4113b70 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=14998497474327939105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09b40099a0 tx=0x7f09b402ed20 comp rx=0 tx=0).stop 2026-02-13T02:46:57.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 -- 10.20.193.78:0/4164145974 shutdown_connections 2026-02-13T02:46:57.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 --2- 10.20.193.78:0/4164145974 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f09c4116520 0x7f09c417a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 --2- 10.20.193.78:0/4164145974 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f09c4114190 0x7f09c4115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 --2- 10.20.193.78:0/4164145974 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c41137a0 0x7f09c4113b70 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=14998497474327939105 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 -- 10.20.193.78:0/4164145974 >> 10.20.193.78:0/4164145974 conn(0x7f09c4061510 msgr2=0x7f09c4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:57.241 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 -- 10.20.193.78:0/4164145974 shutdown_connections 2026-02-13T02:46:57.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.238+0000 7f09caa576c0 1 -- 10.20.193.78:0/4164145974 wait complete. 2026-02-13T02:46:57.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 Processor -- start 2026-02-13T02:46:57.242 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 -- start start 2026-02-13T02:46:57.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f09c41137a0 0x7f09c41214e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:57.243 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f09c4116520 0x7f09c4121a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c4126de0 0x7f09c4127280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f09c41277f0 con 0x7f09c4126de0 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4127960 con 0x7f09c41137a0 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.239+0000 7f09caa576c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4127b20 con 0x7f09c4116520 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c4126de0 0x7f09c4127280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c4126de0 0x7f09c4127280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:37646/0 (socket says 10.20.193.78:37646) 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 -- 10.20.193.78:0/3474451790 learned_addr learned my addr 10.20.193.78:0/3474451790 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09c9a556c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f09c41137a0 0x7f09c41214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09c92546c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f09c4116520 0x7f09c4121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 -- 10.20.193.78:0/3474451790 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f09c4116520 msgr2=0x7f09c4121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:57.244 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f09c4116520 0x7f09c4121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 -- 10.20.193.78:0/3474451790 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f09c41137a0 msgr2=0x7f09c41214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f09c41137a0 0x7f09c41214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 -- 10.20.193.78:0/3474451790 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b4009590 con 0x7f09c4126de0 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09ca2566c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c4126de0 0x7f09c4127280 secure :-1 s=READY pgs=288 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09c0006ea0 tx=0x7f09c000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09b2ffd6c0 1 -- 10.20.193.78:0/3474451790 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09c0003c40 con 0x7f09c4126de0 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09b2ffd6c0 1 -- 10.20.193.78:0/3474451790 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f09c0003da0 con 0x7f09c4126de0 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09b2ffd6c0 1 -- 10.20.193.78:0/3474451790 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09c00081c0 con 0x7f09c4126de0 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c4167fd0 con 0x7f09c4126de0 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.240+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c4168460 con 0x7f09c4126de0 2026-02-13T02:46:57.245 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.241+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f098c005310 con 0x7f09c4126de0 2026-02-13T02:46:57.246 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.243+0000 7f09b2ffd6c0 1 -- 10.20.193.78:0/3474451790 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f09c000d590 con 0x7f09c4126de0 2026-02-13T02:46:57.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.245+0000 7f09b2ffd6c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09a00b56d0 0x7f09a00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:46:57.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.245+0000 7f09b2ffd6c0 1 -- 10.20.193.78:0/3474451790 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f09c00e4c70 con 0x7f09c4126de0 2026-02-13T02:46:57.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.245+0000 7f09b2ffd6c0 1 -- 10.20.193.78:0/3474451790 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f09c00e5160 con 0x7f09c4126de0 2026-02-13T02:46:57.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.245+0000 7f09c9a556c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09a00b56d0 0x7f09a00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:46:57.247 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.245+0000 7f09c9a556c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09a00b56d0 0x7f09a00d5b80 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09b4005b40 tx=0x7f09b40023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:46:57.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.370+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f098c005960 con 0x7f09c4126de0 2026-02-13T02:46:57.372 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.370+0000 7f09b2ffd6c0 1 -- 10.20.193.78:0/3474451790 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f09c00a75d0 con 0x7f09c4126de0 2026-02-13T02:46:57.372 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:46:57.373 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:46:57.373 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.371+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09a00b56d0 msgr2=0x7f09a00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.371+0000 7f09caa576c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09a00b56d0 0x7f09a00d5b80 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09b4005b40 tx=0x7f09b40023a0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.371+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c4126de0 msgr2=0x7f09c4127280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.371+0000 7f09caa576c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c4126de0 0x7f09c4127280 secure :-1 s=READY pgs=288 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09c0006ea0 tx=0x7f09c000ce50 comp rx=0 tx=0).stop 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 shutdown_connections 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f09a00b56d0 0x7f09a00d5b80 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09c4126de0 0x7f09c4127280 unknown :-1 s=CLOSED pgs=288 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f09c4116520 0x7f09c4121a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 --2- 10.20.193.78:0/3474451790 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f09c41137a0 0x7f09c41214e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 >> 10.20.193.78:0/3474451790 conn(0x7f09c4061510 msgr2=0x7f09c4116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:46:57.374 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 shutdown_connections 2026-02-13T02:46:57.375 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:46:57.372+0000 7f09caa576c0 1 -- 10.20.193.78:0/3474451790 wait complete. 2026-02-13T02:46:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:57 trial154 ceph-mon[27921]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:58.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:57 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3474451790' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:58.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:57 trial091 ceph-mon[27614]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:58.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:57 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3474451790' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:57 trial078 ceph-mon[22944]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:46:58.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:57 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3474451790' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:46:59.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:58 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:46:59.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:58 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:46:59.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:58 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:47:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:59 trial154 ceph-mon[27921]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:47:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:47:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:47:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:47:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:47:00.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:47:00.017 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:46:59 trial154 ceph-mon[27921]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:47:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:59 trial091 ceph-mon[27614]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:47:00.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:47:00.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:47:00.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:47:00.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:47:00.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:47:00.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:46:59 trial091 ceph-mon[27614]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:47:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:59 trial078 ceph-mon[22944]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:47:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:47:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:47:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' 2026-02-13T02:47:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:47:00.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:47:00.228 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:46:59 trial078 ceph-mon[22944]: from='mgr.14187 10.20.193.78:0/2976287107' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:47:00.477 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:47:00.663 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:47:00.795 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:00 trial078 ceph-mon[22944]: pgmap v342: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:47:00.795 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:00 trial078 ceph-mon[22944]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T02:47:00.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.862+0000 7f5947fff6c0 1 -- 10.20.193.78:0/1596185135 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f594810f060 msgr2=0x7f594810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:00.864 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.862+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/1596185135 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f594810f060 0x7f594810f430 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=12215748015293700431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c0099a0 tx=0x7f593c02ed00 comp rx=0 tx=0).stop 2026-02-13T02:47:00.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 -- 10.20.193.78:0/1596185135 shutdown_connections 2026-02-13T02:47:00.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/1596185135 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5948115270 0x7f5948175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/1596185135 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f594810fa50 0x7f5948114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/1596185135 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f594810f060 0x7f594810f430 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=12215748015293700431 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 -- 10.20.193.78:0/1596185135 >> 10.20.193.78:0/1596185135 conn(0x7f59480ec980 msgr2=0x7f594810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:00.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 -- 10.20.193.78:0/1596185135 shutdown_connections 2026-02-13T02:47:00.865 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 -- 10.20.193.78:0/1596185135 wait complete. 2026-02-13T02:47:00.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.863+0000 7f5947fff6c0 1 Processor -- start 2026-02-13T02:47:00.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5947fff6c0 1 -- start start 2026-02-13T02:47:00.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5947fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594810f060 0x7f594811d070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:00.867 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5947fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5948115270 0x7f594811d5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5947fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5948122970 0x7f5948122e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5947fff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5948123380 con 0x7f5948122970 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5947fff6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f59481234f0 con 0x7f594810f060 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5947fff6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59481236b0 con 0x7f5948115270 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5948122970 0x7f5948122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f5946ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594810f060 0x7f594811d070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5948122970 0x7f5948122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:37670/0 (socket says 10.20.193.78:37670) 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 -- 10.20.193.78:0/3036863380 learned_addr learned my addr 10.20.193.78:0/3036863380 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59467fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5948115270 0x7f594811d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 -- 10.20.193.78:0/3036863380 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5948115270 msgr2=0x7f594811d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:00.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5948115270 0x7f594811d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 -- 10.20.193.78:0/3036863380 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594810f060 msgr2=0x7f594811d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594810f060 0x7f594811d070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 -- 10.20.193.78:0/3036863380 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c009590 con 0x7f5948122970 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.864+0000 7f59477fe6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5948122970 0x7f5948122e10 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5938006ea0 tx=0x7f593800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.865+0000 7f5927fff6c0 1 -- 10.20.193.78:0/3036863380 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5938003a30 con 0x7f5948122970 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.865+0000 7f5927fff6c0 1 -- 10.20.193.78:0/3036863380 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5938005510 con 0x7f5948122970 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.865+0000 7f5927fff6c0 1 -- 10.20.193.78:0/3036863380 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f593800dd70 con 0x7f5948122970 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.865+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5948163b60 con 0x7f5948122970 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.865+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5948163ff0 con 0x7f5948122970 2026-02-13T02:47:00.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.865+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5948110330 con 0x7f5948122970 2026-02-13T02:47:00.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.867+0000 7f5927fff6c0 1 -- 10.20.193.78:0/3036863380 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f5938003b90 con 0x7f5948122970 2026-02-13T02:47:00.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.869+0000 7f5927fff6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f591c0b5650 0x7f591c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:00.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.869+0000 7f5927fff6c0 1 -- 10.20.193.78:0/3036863380 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f59380e4c30 con 0x7f5948122970 2026-02-13T02:47:00.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.869+0000 7f5946ffd6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f591c0b5650 0x7f591c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:00.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.869+0000 7f5927fff6c0 1 -- 10.20.193.78:0/3036863380 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f59380e50b0 con 0x7f5948122970 2026-02-13T02:47:00.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.870+0000 7f5946ffd6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f591c0b5650 0x7f591c0d5b00 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c031fd0 tx=0x7f593c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:00.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.993+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f594810f430 con 0x7f5948122970 2026-02-13T02:47:00.995 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.994+0000 7f5927fff6c0 1 -- 10.20.193.78:0/3036863380 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f59380a7550 con 0x7f5948122970 2026-02-13T02:47:00.996 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:47:00.996 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:47:00.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f591c0b5650 msgr2=0x7f591c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:00.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f591c0b5650 0x7f591c0d5b00 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c031fd0 tx=0x7f593c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5948122970 msgr2=0x7f5948122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:00.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5948122970 0x7f5948122e10 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5938006ea0 tx=0x7f593800cca0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 shutdown_connections 2026-02-13T02:47:00.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f591c0b5650 0x7f591c0d5b00 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.997 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5948122970 0x7f5948122e10 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5948115270 0x7f594811d5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 --2- 10.20.193.78:0/3036863380 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594810f060 0x7f594811d070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:00.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 >> 10.20.193.78:0/3036863380 conn(0x7f59480ec980 msgr2=0x7f594810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:00.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 shutdown_connections 2026-02-13T02:47:00.998 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:00.995+0000 7f5947fff6c0 1 -- 10.20.193.78:0/3036863380 wait complete. 2026-02-13T02:47:01.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:00 trial154 ceph-mon[27921]: pgmap v342: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:47:01.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:00 trial154 ceph-mon[27921]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T02:47:01.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:00 trial091 ceph-mon[27614]: pgmap v342: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:47:01.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:00 trial091 ceph-mon[27614]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T02:47:02.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:01 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/3036863380' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:02.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:01 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/3036863380' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:02.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:01 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/3036863380' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:03.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:02 trial154 ceph-mon[27921]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T02:47:03.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:02 trial091 ceph-mon[27614]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T02:47:03.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:02 trial078 ceph-mon[22944]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T02:47:04.103 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:47:04.287 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:47:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/2951069404 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d810c850 msgr2=0x7f86d8111890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:04.483 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/2951069404 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d810c850 0x7f86d8111890 secure :-1 s=READY pgs=168 gs=2 cs=0 l=1 c_cookie=5349489795387123967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86c0009970 tx=0x7f86c002ed10 comp rx=0 tx=0).stop 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/2951069404 shutdown_connections 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/2951069404 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d8112070 0x7f86d8172a10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/2951069404 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d810c850 0x7f86d8111890 unknown :-1 s=CLOSED pgs=168 gs=2 cs=0 l=1 c_cookie=5349489795387123967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/2951069404 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86d810be60 0x7f86d810c230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/2951069404 >> 10.20.193.78:0/2951069404 conn(0x7f86d80e9740 msgr2=0x7f86d8109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/2951069404 shutdown_connections 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.481+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/2951069404 wait complete. 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 Processor -- start 2026-02-13T02:47:04.484 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 -- start start 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86d810be60 0x7f86d80f39e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d8112070 0x7f86d8172910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d80f4010 0x7f86d80f92e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86d80f4700 con 0x7f86d80f4010 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f86d80f9820 con 0x7f86d8112070 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86df1bc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86d80f99e0 con 0x7f86d810be60 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d80f4010 0x7f86d80f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d80f4010 0x7f86d80f92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:37688/0 (socket says 10.20.193.78:37688) 2026-02-13T02:47:04.486 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86cffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d8112070 0x7f86d8172910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 -- 10.20.193.78:0/586845984 learned_addr learned my addr 10.20.193.78:0/586845984 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dcf316c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86d810be60 0x7f86d80f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 -- 10.20.193.78:0/586845984 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86d810be60 msgr2=0x7f86d80f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86d810be60 0x7f86d80f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 -- 10.20.193.78:0/586845984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d8112070 msgr2=0x7f86d8172910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d8112070 0x7f86d8172910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.482+0000 7f86dd7326c0 1 -- 10.20.193.78:0/586845984 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c0009590 con 0x7f86d80f4010 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86dcf316c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86d810be60 0x7f86d80f39e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86dd7326c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d80f4010 0x7f86d80f92e0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86d4006ea0 tx=0x7f86d400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86cdffb6c0 1 -- 10.20.193.78:0/586845984 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86d4003c40 con 0x7f86d80f4010 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d80f9cc0 con 0x7f86d80f4010 2026-02-13T02:47:04.487 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86cdffb6c0 1 -- 10.20.193.78:0/586845984 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f86d4003da0 con 0x7f86d80f4010 2026-02-13T02:47:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86cdffb6c0 1 -- 10.20.193.78:0/586845984 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f86d40081c0 con 0x7f86d80f4010 2026-02-13T02:47:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d80fa450 con 0x7f86d80f4010 2026-02-13T02:47:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.483+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d810d130 con 0x7f86d80f4010 2026-02-13T02:47:04.488 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.485+0000 7f86cdffb6c0 1 -- 10.20.193.78:0/586845984 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f86d400d590 con 0x7f86d80f4010 2026-02-13T02:47:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.487+0000 7f86cdffb6c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f86b40b56d0 0x7f86b40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.487+0000 7f86cdffb6c0 1 -- 10.20.193.78:0/586845984 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f86d40e4bb0 con 0x7f86d80f4010 2026-02-13T02:47:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.487+0000 7f86dcf316c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f86b40b56d0 0x7f86b40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:04.489 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.487+0000 7f86cdffb6c0 1 -- 10.20.193.78:0/586845984 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f86d411d620 con 0x7f86d80f4010 2026-02-13T02:47:04.490 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.488+0000 7f86dcf316c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f86b40b56d0 0x7f86b40d5b80 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86c8004750 tx=0x7f86c8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:04.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.610+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f86d80f4b30 con 0x7f86d80f4010 2026-02-13T02:47:04.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.610+0000 7f86cdffb6c0 1 -- 10.20.193.78:0/586845984 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f86d40a74d0 con 0x7f86d80f4010 2026-02-13T02:47:04.612 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:47:04.613 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f86b40b56d0 msgr2=0x7f86b40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f86b40b56d0 0x7f86b40d5b80 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86c8004750 tx=0x7f86c8009260 comp rx=0 tx=0).stop 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d80f4010 msgr2=0x7f86d80f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d80f4010 0x7f86d80f92e0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86d4006ea0 tx=0x7f86d400ce50 comp rx=0 tx=0).stop 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 shutdown_connections 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f86b40b56d0 0x7f86b40d5b80 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f86d80f4010 0x7f86d80f92e0 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86d8112070 0x7f86d8172910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 --2- 10.20.193.78:0/586845984 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86d810be60 0x7f86d80f39e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:04.614 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 >> 10.20.193.78:0/586845984 conn(0x7f86d80e9740 msgr2=0x7f86d810a300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:04.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 shutdown_connections 2026-02-13T02:47:04.615 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:04.612+0000 7f86df1bc6c0 1 -- 10.20.193.78:0/586845984 wait complete. 2026-02-13T02:47:04.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:04 trial078 ceph-mon[22944]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:04.977 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:04 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/586845984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:05.015 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:04 trial154 ceph-mon[27921]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:05.016 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:04 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/586845984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:04 trial091 ceph-mon[27614]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:05.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:04 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/586845984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:07.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:06 trial091 ceph-mon[27614]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:07.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:06 trial078 ceph-mon[22944]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:07.265 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:06 trial154 ceph-mon[27921]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:07.716 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:47:07.901 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:47:08.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 -- 10.20.193.78:0/3765703763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f815bff0 msgr2=0x7f21f817c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:08.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 --2- 10.20.193.78:0/3765703763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f815bff0 0x7f21f817c3d0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=6740949002203304788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21f400aa40 tx=0x7f21f402fe00 comp rx=0 tx=0).stop 2026-02-13T02:47:08.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 -- 10.20.193.78:0/3765703763 shutdown_connections 2026-02-13T02:47:08.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 --2- 10.20.193.78:0/3765703763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f815bff0 0x7f21f817c3d0 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=6740949002203304788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.101 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 --2- 10.20.193.78:0/3765703763 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21f81146d0 0x7f21f815bab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 --2- 10.20.193.78:0/3765703763 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21f8113dc0 0x7f21f8114190 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 -- 10.20.193.78:0/3765703763 >> 10.20.193.78:0/3765703763 conn(0x7f21f8058e80 msgr2=0x7f21f8059280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.098+0000 7f22001206c0 1 -- 10.20.193.78:0/3765703763 shutdown_connections 2026-02-13T02:47:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.099+0000 7f22001206c0 1 -- 10.20.193.78:0/3765703763 wait complete. 2026-02-13T02:47:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.099+0000 7f22001206c0 1 Processor -- start 2026-02-13T02:47:08.102 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.099+0000 7f22001206c0 1 -- start start 2026-02-13T02:47:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f22001206c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f8113dc0 0x7f21f8103700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:08.103 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f22001206c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21f81146d0 0x7f21f8103c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f22001206c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21f815bff0 0x7f21f8109000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f22001206c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8109650 con 0x7f21f8113dc0 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f22001206c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f21f81097c0 con 0x7f21f81146d0 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f22001206c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8109980 con 0x7f21f815bff0 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f8113dc0 0x7f21f8103700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f8113dc0 0x7f21f8103700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:58782/0 (socket says 10.20.193.78:58782) 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 -- 10.20.193.78:0/1334561027 learned_addr learned my addr 10.20.193.78:0/1334561027 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fd6946c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21f81146d0 0x7f21f8103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 -- 10.20.193.78:0/1334561027 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21f815bff0 msgr2=0x7f21f8109000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21f815bff0 0x7f21f8109000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.104 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 -- 10.20.193.78:0/1334561027 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21f81146d0 msgr2=0x7f21f8103c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21f81146d0 0x7f21f8103c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 -- 10.20.193.78:0/1334561027 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f400a660 con 0x7f21f8113dc0 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fd6946c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21f81146d0 0x7f21f8103c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21fde956c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f8113dc0 0x7f21f8103700 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21e8009490 tx=0x7f21e800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.100+0000 7f21e6ffd6c0 1 -- 10.20.193.78:0/1334561027 <== mon.0 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21e8004a80 con 0x7f21f8113dc0 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.101+0000 7f21e6ffd6c0 1 -- 10.20.193.78:0/1334561027 <== mon.0 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f21e8009030 con 0x7f21f8113dc0 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.101+0000 7f21e6ffd6c0 1 -- 10.20.193.78:0/1334561027 <== mon.0 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21e80071c0 con 0x7f21f8113dc0 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.101+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f8109c60 con 0x7f21f8113dc0 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.101+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f8155990 con 0x7f21f8113dc0 2026-02-13T02:47:08.105 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.101+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f8109e80 con 0x7f21f8113dc0 2026-02-13T02:47:08.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.103+0000 7f21e6ffd6c0 1 -- 10.20.193.78:0/1334561027 <== mon.0 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f21e8004060 con 0x7f21f8113dc0 2026-02-13T02:47:08.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.105+0000 7f21e6ffd6c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21d40b56d0 0x7f21d40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:08.106 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.105+0000 7f21e6ffd6c0 1 -- 10.20.193.78:0/1334561027 <== mon.0 v2:10.20.193.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f21e80e3cc0 con 0x7f21f8113dc0 2026-02-13T02:47:08.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.105+0000 7f21fd6946c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21d40b56d0 0x7f21d40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:08.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.105+0000 7f21e6ffd6c0 1 -- 10.20.193.78:0/1334561027 <== mon.0 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f21e80e4140 con 0x7f21f8113dc0 2026-02-13T02:47:08.107 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.105+0000 7f21fd6946c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21d40b56d0 0x7f21d40d5b80 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21f810a090 tx=0x7f21ec009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:08.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.229+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21f805b430 con 0x7f21f8113dc0 2026-02-13T02:47:08.231 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.229+0000 7f21e6ffd6c0 1 -- 10.20.193.78:0/1334561027 <== mon.0 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f21e80a65e0 con 0x7f21f8113dc0 2026-02-13T02:47:08.231 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:47:08.232 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:47:08.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.230+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21d40b56d0 msgr2=0x7f21d40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:08.232 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.230+0000 7f22001206c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21d40b56d0 0x7f21d40d5b80 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21f810a090 tx=0x7f21ec009260 comp rx=0 tx=0).stop 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.230+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f8113dc0 msgr2=0x7f21f8103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.230+0000 7f22001206c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f8113dc0 0x7f21f8103700 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f21e8009490 tx=0x7f21e800bca0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 shutdown_connections 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f21d40b56d0 0x7f21d40d5b80 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f21f815bff0 0x7f21f8109000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f21f81146d0 0x7f21f8103c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 --2- 10.20.193.78:0/1334561027 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f21f8113dc0 0x7f21f8103700 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 >> 10.20.193.78:0/1334561027 conn(0x7f21f8058e80 msgr2=0x7f21f80f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 shutdown_connections 2026-02-13T02:47:08.233 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:08.231+0000 7f22001206c0 1 -- 10.20.193.78:0/1334561027 wait complete. 2026-02-13T02:47:09.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:08 trial091 ceph-mon[27614]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:09.196 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:08 trial091 ceph-mon[27614]: from='client.? 10.20.193.78:0/1334561027' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:09.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:08 trial078 ceph-mon[22944]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:09.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:08 trial078 ceph-mon[22944]: from='client.? 10.20.193.78:0/1334561027' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:09.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:08 trial154 ceph-mon[27921]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:47:09.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:08 trial154 ceph-mon[27921]: from='client.? 10.20.193.78:0/1334561027' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:47:11.195 INFO:journalctl@ceph.mon.b.trial091.stdout:Feb 13 02:47:10 trial091 ceph-mon[27614]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T02:47:11.227 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:10 trial078 ceph-mon[22944]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T02:47:11.266 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:10 trial154 ceph-mon[27921]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T02:47:11.337 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:47:11.522 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:47:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 -- 10.20.193.78:0/133432855 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f061410f060 msgr2=0x7f061410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 --2- 10.20.193.78:0/133432855 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f061410f060 0x7f061410f430 secure :-1 s=READY pgs=145 gs=2 cs=0 l=1 c_cookie=11524615049631765473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06040099a0 tx=0x7f060402ed00 comp rx=0 tx=0).stop 2026-02-13T02:47:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 -- 10.20.193.78:0/133432855 shutdown_connections 2026-02-13T02:47:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 --2- 10.20.193.78:0/133432855 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0614115270 0x7f0614175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 --2- 10.20.193.78:0/133432855 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f061410fa50 0x7f0614114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.713 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 --2- 10.20.193.78:0/133432855 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f061410f060 0x7f061410f430 unknown :-1 s=CLOSED pgs=145 gs=2 cs=0 l=1 c_cookie=11524615049631765473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 -- 10.20.193.78:0/133432855 >> 10.20.193.78:0/133432855 conn(0x7f06140ec980 msgr2=0x7f061410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.710+0000 7f061a2076c0 1 -- 10.20.193.78:0/133432855 shutdown_connections 2026-02-13T02:47:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.711+0000 7f061a2076c0 1 -- 10.20.193.78:0/133432855 wait complete. 2026-02-13T02:47:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.711+0000 7f061a2076c0 1 Processor -- start 2026-02-13T02:47:11.714 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.711+0000 7f061a2076c0 1 -- start start 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.711+0000 7f061a2076c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f061410f060 0x7f061411cfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.711+0000 7f061a2076c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0614115270 0x7f061411d520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f061a2076c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06141228e0 0x7f0614122d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f061a2076c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06141232f0 con 0x7f061410f060 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f061a2076c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0614123460 con 0x7f0614115270 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f061a2076c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0614123620 con 0x7f06141228e0 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f06192056c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f061410f060 0x7f061411cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f06192056c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f061410f060 0x7f061411cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:58806/0 (socket says 10.20.193.78:58806) 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f06192056c0 1 -- 10.20.193.78:0/469558243 learned_addr learned my addr 10.20.193.78:0/469558243 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:47:11.716 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0619a066c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06141228e0 0x7f0614122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0618a046c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0614115270 0x7f061411d520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0619a066c0 1 -- 10.20.193.78:0/469558243 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0614115270 msgr2=0x7f061411d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0619a066c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0614115270 0x7f061411d520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0619a066c0 1 -- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f061410f060 msgr2=0x7f061411cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0619a066c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f061410f060 0x7f061411cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0619a066c0 1 -- 10.20.193.78:0/469558243 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0604009590 con 0x7f06141228e0 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f0619a066c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06141228e0 0x7f0614122d80 secure :-1 s=READY pgs=146 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0610006fd0 tx=0x7f061000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f06027fc6c0 1 -- 10.20.193.78:0/469558243 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0610003c40 con 0x7f06141228e0 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f06027fc6c0 1 -- 10.20.193.78:0/469558243 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f061000a070 con 0x7f06141228e0 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f06027fc6c0 1 -- 10.20.193.78:0/469558243 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f061000dd90 con 0x7f06141228e0 2026-02-13T02:47:11.717 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0614163ad0 con 0x7f06141228e0 2026-02-13T02:47:11.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.712+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0614163f60 con 0x7f06141228e0 2026-02-13T02:47:11.718 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.713+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0614110330 con 0x7f06141228e0 2026-02-13T02:47:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.715+0000 7f06027fc6c0 1 -- 10.20.193.78:0/469558243 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0610005030 con 0x7f06141228e0 2026-02-13T02:47:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.716+0000 7f06027fc6c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f05f00b56d0 0x7f05f00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:47:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.716+0000 7f06027fc6c0 1 -- 10.20.193.78:0/469558243 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8362+0+0 (secure 0 0 0) 0x7f06100e4bb0 con 0x7f06141228e0 2026-02-13T02:47:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.716+0000 7f06192056c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f05f00b56d0 0x7f05f00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:47:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.717+0000 7f06192056c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f05f00b56d0 0x7f05f00d5b80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06040023e0 tx=0x7f0604005b00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:47:11.719 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.717+0000 7f06027fc6c0 1 -- 10.20.193.78:0/469558243 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f06100a74d0 con 0x7f06141228e0 2026-02-13T02:47:11.844 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.842+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f061411e130 con 0x7f06141228e0 2026-02-13T02:47:11.845 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.843+0000 7f06027fc6c0 1 -- 10.20.193.78:0/469558243 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f06100aa680 con 0x7f06141228e0 2026-02-13T02:47:11.845 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:47:11.845 INFO:teuthology.orchestra.run.trial078.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:47:11.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f05f00b56d0 msgr2=0x7f05f00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:11.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f05f00b56d0 0x7f05f00d5b80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06040023e0 tx=0x7f0604005b00 comp rx=0 tx=0).stop 2026-02-13T02:47:11.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06141228e0 msgr2=0x7f0614122d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:47:11.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06141228e0 0x7f0614122d80 secure :-1 s=READY pgs=146 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0610006fd0 tx=0x7f061000cc00 comp rx=0 tx=0).stop 2026-02-13T02:47:11.846 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 shutdown_connections 2026-02-13T02:47:11.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:6800/1569498056,v1:10.20.193.78:6801/1569498056] conn(0x7f05f00b56d0 0x7f05f00d5b80 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f06141228e0 0x7f0614122d80 unknown :-1 s=CLOSED pgs=146 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0614115270 0x7f061411d520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 --2- 10.20.193.78:0/469558243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f061410f060 0x7f061411cfe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:47:11.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 >> 10.20.193.78:0/469558243 conn(0x7f06140ec980 msgr2=0x7f061410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:47:11.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 shutdown_connections 2026-02-13T02:47:11.847 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:47:11.844+0000 7f061a2076c0 1 -- 10.20.193.78:0/469558243 wait complete. 2026-02-13T02:47:11.948 INFO:tasks.cephadm:Teardown begin 2026-02-13T02:47:11.949 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T02:47:11.953 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:47:12.012 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:47:12.042 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:47:12.070 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T02:47:12.070 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T02:47:12.253 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/mon.a/config 2026-02-13T02:47:12.288 INFO:teuthology.orchestra.run.trial078.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T02:47:12.312 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T02:47:12.312 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T02:47:12.312 DEBUG:teuthology.orchestra.run.trial078:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:47:12.351 DEBUG:teuthology.orchestra.run.trial091:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:47:12.370 DEBUG:teuthology.orchestra.run.trial154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:47:12.388 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T02:47:12.388 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T02:47:12.388 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a 2026-02-13T02:47:12.575 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:12 trial078 systemd[1]: Stopping Ceph mon.a for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:12.575 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:12 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a[22940]: 2026-02-13T02:47:12.572+0000 7fd9c1fc46c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:47:12.575 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:12 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a[22940]: 2026-02-13T02:47:12.572+0000 7fd9c1fc46c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T02:47:12.838 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:12 trial078 podman[72963]: 2026-02-13 02:47:12.6948891 +0000 UTC m=+0.145074712 container died ed721521e89a29aac75c936543556c3b4fcf37b712b18864a1e128820c84d6cd (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, license=BSD-3-Clause, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T02:47:12.839 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:12 trial078 podman[72963]: 2026-02-13 02:47:12.753797125 +0000 UTC m=+0.203982737 container remove ed721521e89a29aac75c936543556c3b4fcf37b712b18864a1e128820c84d6cd (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:47:12.839 INFO:journalctl@ceph.mon.a.trial078.stdout:Feb 13 02:47:12 trial078 bash[72963]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-a 2026-02-13T02:47:12.857 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.a.service' 2026-02-13T02:47:12.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:12.932 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T02:47:12.932 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T02:47:12.932 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.b 2026-02-13T02:47:13.176 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.b.service' 2026-02-13T02:47:13.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:13.215 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T02:47:13.215 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T02:47:13.215 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.c 2026-02-13T02:47:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:13 trial154 systemd[1]: Stopping Ceph mon.c for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-c[27917]: 2026-02-13T02:47:13.312+0000 7ff98acb26c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:47:13.516 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 02:47:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mon-c[27917]: 2026-02-13T02:47:13.312+0000 7ff98acb26c0 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-13T02:47:13.613 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mon.c.service' 2026-02-13T02:47:13.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:13.651 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T02:47:13.651 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T02:47:13.651 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.x 2026-02-13T02:47:13.957 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:47:13 trial078 systemd[1]: Stopping Ceph mgr.x for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:13.957 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:47:13 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:47:13.834+0000 7f05814fe6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:47:13.957 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:47:13 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x[23163]: 2026-02-13T02:47:13.834+0000 7f05814fe6c0 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-13T02:47:13.957 INFO:journalctl@ceph.mgr.x.trial078.stdout:Feb 13 02:47:13 trial078 podman[73095]: 2026-02-13 02:47:13.886714039 +0000 UTC m=+0.075553264 container died 1a5aa8f01c08e656eff16d95fe8ed3d06e7f8378b6a107521e9e89a701b93006 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mgr-x, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux) 2026-02-13T02:47:14.076 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.x.service' 2026-02-13T02:47:14.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:14.145 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T02:47:14.145 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T02:47:14.146 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.y 2026-02-13T02:47:14.351 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.y.service' 2026-02-13T02:47:14.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:14.387 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T02:47:14.387 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T02:47:14.388 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.z 2026-02-13T02:47:14.592 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mgr.z.service' 2026-02-13T02:47:14.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:14.626 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T02:47:14.627 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T02:47:14.627 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.0 2026-02-13T02:47:14.977 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:14 trial078 systemd[1]: Stopping Ceph osd.0 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:14.977 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:14 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0[35916]: 2026-02-13T02:47:14.804+0000 7f69e00096c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:14.977 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:14 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0[35916]: 2026-02-13T02:47:14.804+0000 7f69e00096c0 -1 osd.0 79 *** Got signal Terminated *** 2026-02-13T02:47:14.977 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:14 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0[35916]: 2026-02-13T02:47:14.804+0000 7f69e00096c0 -1 osd.0 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:20.217 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:19 trial078 podman[73225]: 2026-02-13 02:47:19.911396991 +0000 UTC m=+5.129235889 container died 95e26eb863103dfcc78356aeb4c7348ea5ff5c27c5de67587ff1e1b1eede44b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, version=10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-13T02:47:20.217 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:19 trial078 podman[73225]: 2026-02-13 02:47:19.969910346 +0000 UTC m=+5.187749244 container remove 95e26eb863103dfcc78356aeb4c7348ea5ff5c27c5de67587ff1e1b1eede44b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, version=10, ceph=True, org.opencontainers.image.version=10, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:47:20.217 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:19 trial078 bash[73225]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0 2026-02-13T02:47:20.471 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:20 trial078 podman[73324]: 2026-02-13 02:47:20.216624757 +0000 UTC m=+0.027375882 container create 21d00f26c3d1a4c56ec7ea99ce618d0739649d69c4e031edfe86f86ce1f4568d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0-deactivate, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, license=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10) 2026-02-13T02:47:20.472 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:20 trial078 podman[73324]: 2026-02-13 02:47:20.263274678 +0000 UTC m=+0.074025813 container init 21d00f26c3d1a4c56ec7ea99ce618d0739649d69c4e031edfe86f86ce1f4568d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:47:20.472 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:20 trial078 podman[73324]: 2026-02-13 02:47:20.268761953 +0000 UTC m=+0.079513078 container start 21d00f26c3d1a4c56ec7ea99ce618d0739649d69c4e031edfe86f86ce1f4568d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, summary=Rocky Linux Base image, version=10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux) 2026-02-13T02:47:20.472 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:20 trial078 podman[73324]: 2026-02-13 02:47:20.269790098 +0000 UTC m=+0.080541223 container attach 21d00f26c3d1a4c56ec7ea99ce618d0739649d69c4e031edfe86f86ce1f4568d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0-deactivate, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7) 2026-02-13T02:47:20.472 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:20 trial078 podman[73324]: 2026-02-13 02:47:20.207193757 +0000 UTC m=+0.017944882 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:47:20.472 INFO:journalctl@ceph.osd.0.trial078.stdout:Feb 13 02:47:20 trial078 podman[73324]: 2026-02-13 02:47:20.458365704 +0000 UTC m=+0.269116829 container died 21d00f26c3d1a4c56ec7ea99ce618d0739649d69c4e031edfe86f86ce1f4568d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, ceph=True, version=10, summary=Rocky Linux Base image, name=rockylinux, license=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T02:47:20.549 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.0.service' 2026-02-13T02:47:20.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:20.617 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T02:47:20.617 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T02:47:20.617 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.1 2026-02-13T02:47:20.946 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:20 trial091 systemd[1]: Stopping Ceph osd.1 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:20.946 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:20 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1[33516]: 2026-02-13T02:47:20.712+0000 7f39f179a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:20.946 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:20 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1[33516]: 2026-02-13T02:47:20.712+0000 7f39f179a6c0 -1 osd.1 79 *** Got signal Terminated *** 2026-02-13T02:47:20.946 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:20 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1[33516]: 2026-02-13T02:47:20.712+0000 7f39f179a6c0 -1 osd.1 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:26.076 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:25 trial091 podman[59640]: 2026-02-13 02:47:25.782722793 +0000 UTC m=+5.082148314 container died 7ecf5b44d46ffe0bf5884f737490bbd81d91cf4229de07750cefd94960fb4147 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:47:26.076 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:25 trial091 podman[59640]: 2026-02-13 02:47:25.791639211 +0000 UTC m=+5.091064732 container remove 7ecf5b44d46ffe0bf5884f737490bbd81d91cf4229de07750cefd94960fb4147 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, name=rockylinux, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause) 2026-02-13T02:47:26.076 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:25 trial091 bash[59640]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1 2026-02-13T02:47:26.076 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:25 trial091 podman[59774]: 2026-02-13 02:47:25.919680856 +0000 UTC m=+0.016488352 container create 4dc5a6889dbfb9097dd71ccd8e72c701a2bc299e546648112da4bbf95e42ac46 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1-deactivate, version=10, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, ceph=True, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:47:26.076 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:25 trial091 podman[59774]: 2026-02-13 02:47:25.949735415 +0000 UTC m=+0.046542911 container init 4dc5a6889dbfb9097dd71ccd8e72c701a2bc299e546648112da4bbf95e42ac46 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T02:47:26.076 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:25 trial091 podman[59774]: 2026-02-13 02:47:25.952424595 +0000 UTC m=+0.049232091 container start 4dc5a6889dbfb9097dd71ccd8e72c701a2bc299e546648112da4bbf95e42ac46 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1-deactivate, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, name=rockylinux, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, license=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True) 2026-02-13T02:47:26.077 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:25 trial091 podman[59774]: 2026-02-13 02:47:25.952970528 +0000 UTC m=+0.049778024 container attach 4dc5a6889dbfb9097dd71ccd8e72c701a2bc299e546648112da4bbf95e42ac46 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-1-deactivate, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, name=rockylinux, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux) 2026-02-13T02:47:26.077 INFO:journalctl@ceph.osd.1.trial091.stdout:Feb 13 02:47:26 trial091 podman[59774]: 2026-02-13 02:47:25.91295883 +0000 UTC m=+0.009766326 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:47:26.126 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.1.service' 2026-02-13T02:47:26.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:26.163 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T02:47:26.163 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T02:47:26.163 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.2 2026-02-13T02:47:26.516 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:26 trial154 systemd[1]: Stopping Ceph osd.2 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:26.516 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:26 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2[34030]: 2026-02-13T02:47:26.266+0000 7f6fbada06c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:26.516 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:26 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2[34030]: 2026-02-13T02:47:26.266+0000 7f6fbada06c0 -1 osd.2 79 *** Got signal Terminated *** 2026-02-13T02:47:26.516 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:26 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2[34030]: 2026-02-13T02:47:26.266+0000 7f6fbada06c0 -1 osd.2 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:31.628 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62224]: 2026-02-13 02:47:31.325814636 +0000 UTC m=+5.071630424 container died b8ea99e27bf3502435fab01e4ea5c6753a8bcf31f633ba07c17684fd7e98dcd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10) 2026-02-13T02:47:31.628 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62224]: 2026-02-13 02:47:31.334974876 +0000 UTC m=+5.080790654 container remove b8ea99e27bf3502435fab01e4ea5c6753a8bcf31f633ba07c17684fd7e98dcd2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, summary=Rocky Linux Base image) 2026-02-13T02:47:31.628 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 bash[62224]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2 2026-02-13T02:47:31.628 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62362]: 2026-02-13 02:47:31.471231372 +0000 UTC m=+0.016088492 container create 7d7e9ee949569586b1c646b52d28e8a29d4ec7f34fcf954c82cfbc0427d43066 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, name=rockylinux, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:47:31.628 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62362]: 2026-02-13 02:47:31.502895806 +0000 UTC m=+0.047752926 container init 7d7e9ee949569586b1c646b52d28e8a29d4ec7f34fcf954c82cfbc0427d43066 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, name=rockylinux) 2026-02-13T02:47:31.628 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62362]: 2026-02-13 02:47:31.505233573 +0000 UTC m=+0.050090703 container start 7d7e9ee949569586b1c646b52d28e8a29d4ec7f34fcf954c82cfbc0427d43066 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.version=10, name=rockylinux, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux) 2026-02-13T02:47:31.628 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62362]: 2026-02-13 02:47:31.505737907 +0000 UTC m=+0.050595037 container attach 7d7e9ee949569586b1c646b52d28e8a29d4ec7f34fcf954c82cfbc0427d43066 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:47:31.629 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62362]: 2026-02-13 02:47:31.464542118 +0000 UTC m=+0.009399238 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:47:31.629 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 02:47:31 trial154 podman[62362]: 2026-02-13 02:47:31.624727876 +0000 UTC m=+0.169584996 container died 7d7e9ee949569586b1c646b52d28e8a29d4ec7f34fcf954c82cfbc0427d43066 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-2-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , version=10) 2026-02-13T02:47:31.655 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.2.service' 2026-02-13T02:47:31.692 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:31.693 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T02:47:31.693 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T02:47:31.693 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.3 2026-02-13T02:47:32.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:31 trial078 systemd[1]: Stopping Ceph osd.3 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:32.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:31 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3[41749]: 2026-02-13T02:47:31.878+0000 7f75e05ff6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:32.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:31 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3[41749]: 2026-02-13T02:47:31.878+0000 7f75e05ff6c0 -1 osd.3 79 *** Got signal Terminated *** 2026-02-13T02:47:32.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:31 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3[41749]: 2026-02-13T02:47:31.879+0000 7f75e05ff6c0 -1 osd.3 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:37.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:36 trial078 podman[73443]: 2026-02-13 02:47:36.974820397 +0000 UTC m=+5.118119695 container died 3be0e142f0c9d6261b4e69d5d298dd0bcafd5a3b85c20f2bf95c7364d02225cf (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image) 2026-02-13T02:47:37.227 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:37 trial078 podman[73443]: 2026-02-13 02:47:37.034273893 +0000 UTC m=+5.177573181 container remove 3be0e142f0c9d6261b4e69d5d298dd0bcafd5a3b85c20f2bf95c7364d02225cf (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, io.buildah.version=1.33.7) 2026-02-13T02:47:37.228 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:37 trial078 bash[73443]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3 2026-02-13T02:47:37.520 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:37 trial078 podman[73546]: 2026-02-13 02:47:37.28458129 +0000 UTC m=+0.027341187 container create 51cb87bf31ce4cd42cd5f919f0f6892e02a560a1d500c04c6e7953c4e23a6473 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, name=rockylinux, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:47:37.520 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:37 trial078 podman[73546]: 2026-02-13 02:47:37.336844012 +0000 UTC m=+0.079603929 container init 51cb87bf31ce4cd42cd5f919f0f6892e02a560a1d500c04c6e7953c4e23a6473 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3-deactivate, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:47:37.521 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:37 trial078 podman[73546]: 2026-02-13 02:47:37.342543083 +0000 UTC m=+0.085302990 container start 51cb87bf31ce4cd42cd5f919f0f6892e02a560a1d500c04c6e7953c4e23a6473 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3-deactivate, io.buildah.version=1.33.7, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux) 2026-02-13T02:47:37.521 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:37 trial078 podman[73546]: 2026-02-13 02:47:37.343493783 +0000 UTC m=+0.086253700 container attach 51cb87bf31ce4cd42cd5f919f0f6892e02a560a1d500c04c6e7953c4e23a6473 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:47:37.521 INFO:journalctl@ceph.osd.3.trial078.stdout:Feb 13 02:47:37 trial078 podman[73546]: 2026-02-13 02:47:37.274522636 +0000 UTC m=+0.017282543 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:47:37.607 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.3.service' 2026-02-13T02:47:37.677 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:37.677 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T02:47:37.677 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T02:47:37.678 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.4 2026-02-13T02:47:38.195 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:37 trial091 systemd[1]: Stopping Ceph osd.4 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:38.196 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:37 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4[39769]: 2026-02-13T02:47:37.773+0000 7f8bbd1636c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:38.196 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:37 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4[39769]: 2026-02-13T02:47:37.773+0000 7f8bbd1636c0 -1 osd.4 79 *** Got signal Terminated *** 2026-02-13T02:47:38.196 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:37 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4[39769]: 2026-02-13T02:47:37.773+0000 7f8bbd1636c0 -1 osd.4 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:41.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:40 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:40.717+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:41.445 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4[39769]: 2026-02-13T02:47:41.151+0000 7f8bb58206c0 -1 osd.4 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.965320+0000 front 2026-02-13T02:47:17.965070+0000 (oldest deadline 2026-02-13T02:47:40.265130+0000) 2026-02-13T02:47:41.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:41.314+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:41.477 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:41 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:41.181+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:42.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:41.676+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:42.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:41 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:41.727+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:42.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:42 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:42.351+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:42.446 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4[39769]: 2026-02-13T02:47:42.168+0000 7f8bb58206c0 -1 osd.4 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.965320+0000 front 2026-02-13T02:47:17.965070+0000 (oldest deadline 2026-02-13T02:47:40.265130+0000) 2026-02-13T02:47:42.477 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:42 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:42.197+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:42.977 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:42 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:42.491+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:43.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:42 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:42.681+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:43.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:42 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:42.707+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:43.131 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 podman[59914]: 2026-02-13 02:47:42.831903314 +0000 UTC m=+5.071307634 container died b9df0f63ad7dd9f1a3efb5098a12f4f4e87e4c87bfaceac45e1704665de4e380 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image) 2026-02-13T02:47:43.131 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 podman[59914]: 2026-02-13 02:47:42.842020431 +0000 UTC m=+5.081424751 container remove b9df0f63ad7dd9f1a3efb5098a12f4f4e87e4c87bfaceac45e1704665de4e380 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, version=10, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, license=BSD-3-Clause) 2026-02-13T02:47:43.131 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 bash[59914]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4 2026-02-13T02:47:43.131 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 podman[60051]: 2026-02-13 02:47:42.965379265 +0000 UTC m=+0.017380077 container create 98c79b6db0b08637e0c46a66a2e6fe7c21dd24636ede11885085451d988cc3e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.version=10, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:47:43.132 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 podman[60051]: 2026-02-13 02:47:42.994805427 +0000 UTC m=+0.046806179 container init 98c79b6db0b08637e0c46a66a2e6fe7c21dd24636ede11885085451d988cc3e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:47:43.132 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 podman[60051]: 2026-02-13 02:47:42.997311318 +0000 UTC m=+0.049312070 container start 98c79b6db0b08637e0c46a66a2e6fe7c21dd24636ede11885085451d988cc3e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, OSD_FLAVOR=default, name=rockylinux, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:47:43.132 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:42 trial091 podman[60051]: 2026-02-13 02:47:42.997741646 +0000 UTC m=+0.049742408 container attach 98c79b6db0b08637e0c46a66a2e6fe7c21dd24636ede11885085451d988cc3e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4-deactivate, license=BSD-3-Clause, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:47:43.132 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:43 trial091 podman[60051]: 2026-02-13 02:47:42.959103136 +0000 UTC m=+0.011103898 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:47:43.132 INFO:journalctl@ceph.osd.4.trial091.stdout:Feb 13 02:47:43 trial091 podman[60051]: 2026-02-13 02:47:43.130989153 +0000 UTC m=+0.182989915 container died 98c79b6db0b08637e0c46a66a2e6fe7c21dd24636ede11885085451d988cc3e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-4-deactivate, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:47:43.163 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.4.service' 2026-02-13T02:47:43.200 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:43.200 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T02:47:43.200 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T02:47:43.200 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.5 2026-02-13T02:47:43.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:43 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:43.332+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:43.462 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:43 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:43.203+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:43.516 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:43 trial154 systemd[1]: Stopping Ceph osd.5 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:43.516 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:43 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:43.272+0000 7f58b45296c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.174854+0000 front 2026-02-13T02:47:18.174839+0000 (oldest deadline 2026-02-13T02:47:42.874833+0000) 2026-02-13T02:47:43.516 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:43 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:43.303+0000 7f58b7e646c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:43.516 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:43 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:43.303+0000 7f58b7e646c0 -1 osd.5 79 *** Got signal Terminated *** 2026-02-13T02:47:43.516 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:43 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:43.303+0000 7f58b7e646c0 -1 osd.5 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:43.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:43 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:43.461+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:44.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:43 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:43.653+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:44.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:43 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:43.666+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:44.618 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:44 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:44.276+0000 7f58b45296c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.174854+0000 front 2026-02-13T02:47:18.174839+0000 (oldest deadline 2026-02-13T02:47:42.874833+0000) 2026-02-13T02:47:44.695 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:44 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:44.346+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:44.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:44 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:44.449+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:44.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:44 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:44.229+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:45.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:44 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:44.647+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:45.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:44 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:44.615+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:45.611 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:45 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:45.324+0000 7f58b45296c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.174854+0000 front 2026-02-13T02:47:18.174839+0000 (oldest deadline 2026-02-13T02:47:42.874833+0000) 2026-02-13T02:47:45.695 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:45 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:45.307+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:45.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:45 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:45.250+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:45.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:45 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:45.403+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:46.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:45 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:45.608+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:46.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:45 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:45.690+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:46.695 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:46 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:46.291+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:46.696 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:46 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:46.291+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:46.697 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:46 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:46.316+0000 7f58b45296c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.174854+0000 front 2026-02-13T02:47:18.174839+0000 (oldest deadline 2026-02-13T02:47:42.874833+0000) 2026-02-13T02:47:46.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:46 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:46.561+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:46.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:46 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:46.395+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:46.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:46 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:46.227+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:47.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:46 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:46.694+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:47.477 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:47 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:47.391+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:47.477 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:47 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:47.391+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:47.477 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:47 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:47.223+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:47.478 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:47 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:47.223+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.879774+0000 front 2026-02-13T02:47:20.880084+0000 (oldest deadline 2026-02-13T02:47:46.779744+0000) 2026-02-13T02:47:47.681 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:47 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:47.256+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:47.682 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:47 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:47.256+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:47.708 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:47 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:47.568+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:47.709 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:47 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:47.320+0000 7f58b45296c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.174854+0000 front 2026-02-13T02:47:18.174839+0000 (oldest deadline 2026-02-13T02:47:42.874833+0000) 2026-02-13T02:47:47.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:47 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:47.681+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:48.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:47 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:47.705+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:48.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:47 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:47.705+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:48.528 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:48 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:48.273+0000 7f58b45296c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.174854+0000 front 2026-02-13T02:47:18.174839+0000 (oldest deadline 2026-02-13T02:47:42.874833+0000) 2026-02-13T02:47:48.528 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:48 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5[40317]: 2026-02-13T02:47:48.273+0000 7f58b45296c0 -1 osd.5 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:25.675424+0000 front 2026-02-13T02:47:25.675518+0000 (oldest deadline 2026-02-13T02:47:47.375429+0000) 2026-02-13T02:47:48.528 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:48 trial154 podman[62493]: 2026-02-13 02:47:48.362195073 +0000 UTC m=+5.071336113 container died abc67a0c99e7250ab082330275fe37b4fb10849f44d98bddfb4d5789b096ff4f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, version=10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:47:48.528 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:48 trial154 podman[62493]: 2026-02-13 02:47:48.37087313 +0000 UTC m=+5.080014160 container remove abc67a0c99e7250ab082330275fe37b4fb10849f44d98bddfb4d5789b096ff4f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:47:48.528 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:48 trial154 bash[62493]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5 2026-02-13T02:47:48.528 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 02:47:48 trial154 podman[62625]: 2026-02-13 02:47:48.498487085 +0000 UTC m=+0.015679907 container create fc6a579063c9d79b315f0284a0471dac2a04f45282c8fcdcddf7f29932986c61 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-5-deactivate, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.title=rockylinux, version=10, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:47:48.696 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.5.service' 2026-02-13T02:47:48.697 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:48 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:48.235+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:48.697 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:48 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:48.235+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:48.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:48 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:48.269+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:48.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:48 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:48.269+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.879774+0000 front 2026-02-13T02:47:20.880084+0000 (oldest deadline 2026-02-13T02:47:46.779744+0000) 2026-02-13T02:47:48.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:48 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:48.419+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:48.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:48 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:48.419+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:48.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:48.733 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T02:47:48.733 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T02:47:48.733 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.6 2026-02-13T02:47:49.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:48 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:48.589+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:49.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:48 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:48.589+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:49.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:48 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:48.726+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:49.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:48 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:48.726+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:49.195 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:48 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:48.729+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:49.227 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:48 trial078 systemd[1]: Stopping Ceph osd.6 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:49.227 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:48 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:48.919+0000 7fecc13706c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:49.227 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:48 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:48.919+0000 7fecc13706c0 -1 osd.6 79 *** Got signal Terminated *** 2026-02-13T02:47:49.227 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:48 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:48.919+0000 7fecc13706c0 -1 osd.6 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:49.695 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:49 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:49.202+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:49.695 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:49 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:49.202+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:49.726 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:49 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:49.235+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:49.726 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:49 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:49.235+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.879774+0000 front 2026-02-13T02:47:20.880084+0000 (oldest deadline 2026-02-13T02:47:46.779744+0000) 2026-02-13T02:47:49.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:49 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:49.467+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:49.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:49 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:49.467+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:50.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:49 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:49.611+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:50.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:49 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:49.611+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:50.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:49 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:49.751+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:50.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:49 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:49.751+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:50.161 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:49 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:49.698+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:50.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:50 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:50.161+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:50.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:50 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:50.161+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:50.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:50 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:50.444+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:50.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:50 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:50.444+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:50.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:50 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:50.269+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:50.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:50 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:50.269+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.879774+0000 front 2026-02-13T02:47:20.880084+0000 (oldest deadline 2026-02-13T02:47:46.779744+0000) 2026-02-13T02:47:51.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:50 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:50.602+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:51.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:50 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:50.602+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:51.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:50 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:50.789+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:51.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:50 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:50.789+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:51.148 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:50 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:50.697+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:51.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:51 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:51.148+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:51.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:51 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:51.148+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:51.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:51 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:51.286+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:51.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:51 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:51.286+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.879774+0000 front 2026-02-13T02:47:20.880084+0000 (oldest deadline 2026-02-13T02:47:46.779744+0000) 2026-02-13T02:47:51.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:51 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:51.482+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:51.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:51 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:51.482+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:51.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:51 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:51.661+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:52.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:51 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:51.798+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:52.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:51 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:51.798+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:52.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:51 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:51.798+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:52.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:51 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:51.647+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:52.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:51 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:51.647+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:52.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:52 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:52.174+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:52.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:52 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:52.174+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:52.726 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:52 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:52.268+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:52.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:52 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:52.268+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.879774+0000 front 2026-02-13T02:47:20.880084+0000 (oldest deadline 2026-02-13T02:47:46.779744+0000) 2026-02-13T02:47:52.727 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:52 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:52.268+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.080374+0000 front 2026-02-13T02:47:29.080474+0000 (oldest deadline 2026-02-13T02:47:51.380210+0000) 2026-02-13T02:47:52.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:52 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:52.441+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:52.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:52 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:52.441+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:52.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:52 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:52.441+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:52.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:52 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:52.615+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:53.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:52 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:52.621+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:53.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:52 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:52.621+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:53.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:52 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:52.836+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:53.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:52 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:52.836+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:53.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:52 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:52.836+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:53.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:53 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:53.185+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:53.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:53 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:53.185+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:53.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:53 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:53.185+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:47:53.476 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:53.222+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:16.179251+0000 front 2026-02-13T02:47:16.180083+0000 (oldest deadline 2026-02-13T02:47:40.879456+0000) 2026-02-13T02:47:53.476 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:53.222+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.879774+0000 front 2026-02-13T02:47:20.880084+0000 (oldest deadline 2026-02-13T02:47:46.779744+0000) 2026-02-13T02:47:53.476 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6[47487]: 2026-02-13T02:47:53.222+0000 7fecb9a2d6c0 -1 osd.6 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.080374+0000 front 2026-02-13T02:47:29.080474+0000 (oldest deadline 2026-02-13T02:47:51.380210+0000) 2026-02-13T02:47:53.477 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:53.425+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:53.477 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:53.425+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:53.477 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:53 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:53.425+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:53.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:53 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:53.663+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:53.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:53 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:53.663+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:27.511242+0000 front 2026-02-13T02:47:27.511258+0000 (oldest deadline 2026-02-13T02:47:52.811322+0000) 2026-02-13T02:47:54.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:53 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:53.652+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:54.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:53 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:53.652+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:54.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:53 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:53.652+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:47:54.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:53 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:53.838+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:54.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:53 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:53.838+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:54.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:53 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:53.838+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:54.335 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73658]: 2026-02-13 02:47:54.035743159 +0000 UTC m=+5.139660731 container died 8ce9f2425ddf2dfcfb8f87bcea59dfec4ec9204f4fb853a4d697b10c817fe068 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, summary=Rocky Linux Base image, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:47:54.336 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73658]: 2026-02-13 02:47:54.093493996 +0000 UTC m=+5.197411578 container remove 8ce9f2425ddf2dfcfb8f87bcea59dfec4ec9204f4fb853a4d697b10c817fe068 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:47:54.336 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 bash[73658]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6 2026-02-13T02:47:54.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:54.159+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:54.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:54.159+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:54.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:54.159+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:47:54.586 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:54 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:54.390+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:54.586 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:54 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:54.390+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:54.586 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:54 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:54.390+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:54.586 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73755]: 2026-02-13 02:47:54.335044918 +0000 UTC m=+0.026952509 container create 5626db3c86e4470d267b2f377883b5fdbbbf95cd55627018f106c28ea238a894 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, version=10, summary=Rocky Linux Base image) 2026-02-13T02:47:54.587 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73755]: 2026-02-13 02:47:54.382599032 +0000 UTC m=+0.074506623 container init 5626db3c86e4470d267b2f377883b5fdbbbf95cd55627018f106c28ea238a894 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-13T02:47:54.587 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73755]: 2026-02-13 02:47:54.38792207 +0000 UTC m=+0.079829661 container start 5626db3c86e4470d267b2f377883b5fdbbbf95cd55627018f106c28ea238a894 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause) 2026-02-13T02:47:54.587 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73755]: 2026-02-13 02:47:54.388907786 +0000 UTC m=+0.080815377 container attach 5626db3c86e4470d267b2f377883b5fdbbbf95cd55627018f106c28ea238a894 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7) 2026-02-13T02:47:54.587 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73755]: 2026-02-13 02:47:54.325936302 +0000 UTC m=+0.017843893 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:47:54.587 INFO:journalctl@ceph.osd.6.trial078.stdout:Feb 13 02:47:54 trial078 podman[73755]: 2026-02-13 02:47:54.573345293 +0000 UTC m=+0.265252884 container died 5626db3c86e4470d267b2f377883b5fdbbbf95cd55627018f106c28ea238a894 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-6-deactivate, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, ceph=True, summary=Rocky Linux Base image, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:47:54.662 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.6.service' 2026-02-13T02:47:54.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:47:54.733 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T02:47:54.733 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T02:47:54.733 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.7 2026-02-13T02:47:54.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:54.662+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:54.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:54.662+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:27.511242+0000 front 2026-02-13T02:47:27.511258+0000 (oldest deadline 2026-02-13T02:47:52.811322+0000) 2026-02-13T02:47:54.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:54 trial091 systemd[1]: Stopping Ceph osd.7 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:47:54.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:54.830+0000 7f10ad40f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:47:54.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:54.830+0000 7f10ad40f6c0 -1 osd.7 79 *** Got signal Terminated *** 2026-02-13T02:47:54.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:54 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:54.830+0000 7f10ad40f6c0 -1 osd.7 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:47:55.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:54 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:54.825+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:55.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:54 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:54.825+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:55.015 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:54 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:54.825+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:55.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:54 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:54.642+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:55.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:54 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:54.642+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:55.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:54 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:54.642+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:47:55.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:55 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:55.131+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:55.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:55 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:55.131+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:55.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:55 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:55.131+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:47:55.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:55.343+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:55.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:55.343+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:55.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:55 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:55.343+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:55.878 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:55 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:55.621+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:55.878 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:55 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:55.621+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:55.878 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:55 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:55.621+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:47:56.144 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:55 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:55.702+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:56.144 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:55 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:55.702+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:27.511242+0000 front 2026-02-13T02:47:27.511258+0000 (oldest deadline 2026-02-13T02:47:52.811322+0000) 2026-02-13T02:47:56.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:55 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:55.875+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:56.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:55 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:55.875+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:56.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:55 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:55.875+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:56.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:56 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:56.143+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:56.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:56 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:56.143+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:56.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:56 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:56.143+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:47:56.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:56.314+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:56.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:56.314+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:56.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:56 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:56.314+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:57.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:56 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:56.638+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:57.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:56 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:56.638+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:57.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:56 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:56.638+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:47:57.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:56 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:56.858+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:57.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:56 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:56.858+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:57.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:56 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:56.858+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:57.137 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:56 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:56.729+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:57.137 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:56 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:56.729+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:27.511242+0000 front 2026-02-13T02:47:27.511258+0000 (oldest deadline 2026-02-13T02:47:52.811322+0000) 2026-02-13T02:47:57.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:57 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:57.136+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:57.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:57 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:57.136+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:57.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:57 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:57.136+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:47:57.726 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:57 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:57.354+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:57.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:57 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:57.354+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:57.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:57 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:57.354+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:58.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:57 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:57.637+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:58.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:57 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:57.637+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:58.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:57 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:57.637+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:47:58.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:57 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:57.836+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:58.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:57 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:57.836+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:58.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:57 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:57.836+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:58.092 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:57 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:57.710+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:58.092 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:57 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:57.710+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:27.511242+0000 front 2026-02-13T02:47:27.511258+0000 (oldest deadline 2026-02-13T02:47:52.811322+0000) 2026-02-13T02:47:58.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:58 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:58.091+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:58.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:58 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:58.091+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:58.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:58 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:58.091+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:47:58.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:58 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:58.091+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:47:58.726 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:58 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:58.370+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:58.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:58 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:58.370+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:58.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:58 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:58.370+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:59.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:58 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:58.643+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:47:59.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:58 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:58.643+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:47:59.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:58 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:58.643+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:47:59.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:58 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:58.859+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:47:59.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:58 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:58.859+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:47:59.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:58 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:58.859+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:47:59.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:58 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:58.859+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:47:59.069 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:58 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:58.716+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:59.069 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:58 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:58.716+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:27.511242+0000 front 2026-02-13T02:47:27.511258+0000 (oldest deadline 2026-02-13T02:47:52.811322+0000) 2026-02-13T02:47:59.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:59 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:59.068+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:47:59.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:59 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:59.068+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:47:59.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:59 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:59.068+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:47:59.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:47:59 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:47:59.068+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:47:59.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:59.334+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:47:59.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:59.334+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:47:59.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:47:59 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:47:59.334+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:47:59.945 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:59 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:59.685+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.610898+0000 front 2026-02-13T02:47:24.610945+0000 (oldest deadline 2026-02-13T02:47:47.511006+0000) 2026-02-13T02:47:59.946 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:59 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7[46040]: 2026-02-13T02:47:59.685+0000 7f10a9ad46c0 -1 osd.7 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:27.511242+0000 front 2026-02-13T02:47:27.511258+0000 (oldest deadline 2026-02-13T02:47:52.811322+0000) 2026-02-13T02:47:59.946 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:59 trial091 podman[60187]: 2026-02-13 02:47:59.890203633 +0000 UTC m=+5.071580335 container died 08062c551f5577ddbef6d3237b6b58991fc1aa2a98ee9057aec32f3856aa847d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, version=10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T02:47:59.946 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:59 trial091 podman[60187]: 2026-02-13 02:47:59.898975423 +0000 UTC m=+5.080352135 container remove 08062c551f5577ddbef6d3237b6b58991fc1aa2a98ee9057aec32f3856aa847d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, name=rockylinux) 2026-02-13T02:47:59.946 INFO:journalctl@ceph.osd.7.trial091.stdout:Feb 13 02:47:59 trial091 bash[60187]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-7 2026-02-13T02:48:00.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:59.678+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:48:00.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:59.678+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:48:00.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:59.678+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:48:00.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:47:59.678+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.562891+0000 front 2026-02-13T02:47:35.562955+0000 (oldest deadline 2026-02-13T02:47:59.662877+0000) 2026-02-13T02:48:00.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:59.881+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:00.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:59.881+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:00.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:59.881+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:00.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:47:59 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:47:59.881+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:00.217 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.7.service' 2026-02-13T02:48:00.254 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:00.255 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T02:48:00.255 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T02:48:00.255 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.8 2026-02-13T02:48:00.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:00 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:00.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:00.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:00 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:00.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:00.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:00 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:00.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:00.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:00 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:00.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:00.692 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 systemd[1]: Stopping Ceph osd.8 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:00.692 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:00.348+0000 7fe7f6f6f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:48:00.692 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:00.348+0000 7fe7f6f6f6c0 -1 osd.8 79 *** Got signal Terminated *** 2026-02-13T02:48:00.692 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:00.348+0000 7fe7f6f6f6c0 -1 osd.8 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:48:00.726 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:00.358+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:00.726 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:00.358+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:00.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:00 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:00.358+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:01.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:00.689+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:48:01.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:00.689+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:48:01.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:00.689+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:48:01.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:00.689+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.562891+0000 front 2026-02-13T02:47:35.562955+0000 (oldest deadline 2026-02-13T02:47:59.662877+0000) 2026-02-13T02:48:01.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:00.906+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:01.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:00.906+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:01.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:00.906+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:01.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:00 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:00.906+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:01.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:01 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:01.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:01.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:01 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:01.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:01.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:01 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:01.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:01.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:01 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:01.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:01.726 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:01 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:01.332+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:01.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:01 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:01.332+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:01.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:01 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:01.332+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:01.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:01 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:01.332+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:02.015 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:01.713+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:48:02.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:01.713+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:48:02.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:01.713+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:48:02.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:01.713+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.562891+0000 front 2026-02-13T02:47:35.562955+0000 (oldest deadline 2026-02-13T02:47:59.662877+0000) 2026-02-13T02:48:02.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:01.952+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:02.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:01.952+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:02.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:01.952+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:02.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:01 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:01.952+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:02.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:02 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:02.081+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:02.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:02 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:02.081+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:02.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:02 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:02.081+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:02.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:02 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:02.081+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:02.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:02 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:02.330+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:02.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:02 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:02.330+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:02.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:02 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:02.330+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:02.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:02 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:02.330+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:03.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:02.699+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:48:03.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:02.699+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:48:03.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:02.699+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:48:03.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:02.699+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.562891+0000 front 2026-02-13T02:47:35.562955+0000 (oldest deadline 2026-02-13T02:47:59.662877+0000) 2026-02-13T02:48:03.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:02.929+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:03.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:02.929+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:03.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:02.929+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:03.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:02 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:02.929+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:03.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:03 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:03.108+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:03.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:03 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:03.108+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:03.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:03 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:03.108+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:03.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:03 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:03.108+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:03.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:03.360+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:03.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:03.360+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:03.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:03.360+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:03.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:03 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:03.360+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:04.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:03.676+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:48:04.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:03.676+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:48:04.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:03.676+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:48:04.016 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:03.676+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.562891+0000 front 2026-02-13T02:47:35.562955+0000 (oldest deadline 2026-02-13T02:47:59.662877+0000) 2026-02-13T02:48:04.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:03.901+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:04.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:03.901+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:04.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:03.901+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:04.017 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:03 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:03.901+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:04.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:04 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:04.085+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:04.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:04 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:04.085+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:04.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:04 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:04.085+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:04.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:04 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:04.085+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:04.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:04 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:04.085+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:04.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:04 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:04.338+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:04.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:04 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:04.338+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:04.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:04 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:04.338+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:04.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:04 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:04.338+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:04.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:04 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:04.338+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:41.000577+0000 front 2026-02-13T02:47:41.000639+0000 (oldest deadline 2026-02-13T02:48:03.900595+0000) 2026-02-13T02:48:05.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:04.918+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:05.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:04.918+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:05.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:04.918+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:05.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:04.918+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:05.017 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:04.701+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:14.661261+0000 front 2026-02-13T02:47:14.661250+0000 (oldest deadline 2026-02-13T02:47:40.561224+0000) 2026-02-13T02:48:05.017 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:04.701+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.761862+0000 front 2026-02-13T02:47:22.761895+0000 (oldest deadline 2026-02-13T02:47:48.061910+0000) 2026-02-13T02:48:05.017 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:04.701+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.162232+0000 front 2026-02-13T02:47:29.162240+0000 (oldest deadline 2026-02-13T02:47:53.262413+0000) 2026-02-13T02:48:05.017 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:04.701+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.562891+0000 front 2026-02-13T02:47:35.562955+0000 (oldest deadline 2026-02-13T02:47:59.662877+0000) 2026-02-13T02:48:05.017 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:04 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8[46726]: 2026-02-13T02:48:04.701+0000 7fe7ef62c6c0 -1 osd.8 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:39.663076+0000 front 2026-02-13T02:47:39.663061+0000 (oldest deadline 2026-02-13T02:48:04.363092+0000) 2026-02-13T02:48:05.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:05 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:05.109+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:05.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:05 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:05.109+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:05.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:05 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:05.109+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:05.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:05 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:05.109+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:05.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:05 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:05.109+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:05.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62761]: 2026-02-13 02:48:05.406662283 +0000 UTC m=+5.071000044 container died 2b1c99d7a46906513f08dc29d57f0ebf71ec635a60f7ae5716b4181fddf5753b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.version=10, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:48:05.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62761]: 2026-02-13 02:48:05.416608515 +0000 UTC m=+5.080946286 container remove 2b1c99d7a46906513f08dc29d57f0ebf71ec635a60f7ae5716b4181fddf5753b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8, ceph=True, org.opencontainers.image.version=10, OSD_FLAVOR=default, version=10, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:48:05.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 bash[62761]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8 2026-02-13T02:48:05.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62891]: 2026-02-13 02:48:05.537325958 +0000 UTC m=+0.015388482 container create e7f17df53fa3c3b5ddc6451b5ee88b9d507cc1cb8e5c280f5bb54770e65722aa (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8-deactivate, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, name=rockylinux, io.buildah.version=1.33.7, version=10, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:48:05.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62891]: 2026-02-13 02:48:05.566638218 +0000 UTC m=+0.044700742 container init e7f17df53fa3c3b5ddc6451b5ee88b9d507cc1cb8e5c280f5bb54770e65722aa (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True) 2026-02-13T02:48:05.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62891]: 2026-02-13 02:48:05.569265006 +0000 UTC m=+0.047327540 container start e7f17df53fa3c3b5ddc6451b5ee88b9d507cc1cb8e5c280f5bb54770e65722aa (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8-deactivate, summary=Rocky Linux Base image, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T02:48:05.697 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62891]: 2026-02-13 02:48:05.569880318 +0000 UTC m=+0.047942842 container attach e7f17df53fa3c3b5ddc6451b5ee88b9d507cc1cb8e5c280f5bb54770e65722aa (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.title=rockylinux, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, license=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:48:05.698 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62891]: 2026-02-13 02:48:05.531383843 +0000 UTC m=+0.009446367 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:48:05.698 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 02:48:05 trial154 podman[62891]: 2026-02-13 02:48:05.693709667 +0000 UTC m=+0.171772191 container died e7f17df53fa3c3b5ddc6451b5ee88b9d507cc1cb8e5c280f5bb54770e65722aa (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:48:05.725 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.8.service' 2026-02-13T02:48:05.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.379+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:05.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.379+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:05.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.379+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:05.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.379+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:05.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.379+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:41.000577+0000 front 2026-02-13T02:47:41.000639+0000 (oldest deadline 2026-02-13T02:48:03.900595+0000) 2026-02-13T02:48:05.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:05.762 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T02:48:05.762 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T02:48:05.762 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.9 2026-02-13T02:48:06.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:05 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:05.924+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:06.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:05 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:05.924+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:06.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:05 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:05.924+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:06.016 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:05 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:05.924+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:06.227 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 systemd[1]: Stopping Ceph osd.9 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:06.227 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.942+0000 7f99a0a456c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:48:06.227 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.943+0000 7f99a0a456c0 -1 osd.9 79 *** Got signal Terminated *** 2026-02-13T02:48:06.227 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:05 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:05.943+0000 7f99a0a456c0 -1 osd.9 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:48:06.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:06 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:06.077+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:06.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:06 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:06.077+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:06.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:06 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:06.077+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:06.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:06 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:06.077+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:06.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:06 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:06.077+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:06.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:06 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:06.422+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:06.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:06 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:06.422+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:06.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:06 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:06.422+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:06.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:06 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:06.422+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:06.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:06 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:06.422+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:41.000577+0000 front 2026-02-13T02:47:41.000639+0000 (oldest deadline 2026-02-13T02:48:03.900595+0000) 2026-02-13T02:48:07.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:06 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:06.944+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:07.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:06 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:06.944+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:07.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:06 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:06.944+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:07.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:06 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:06.944+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:07.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:06 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:06.944+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:07.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:07 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:07.090+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:07.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:07 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:07.090+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:07.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:07 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:07.090+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:07.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:07 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:07.090+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:07.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:07 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:07.090+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:07.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:07 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:07.458+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:07.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:07 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:07.458+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:07.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:07 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:07.458+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:07.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:07 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:07.458+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:07.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:07 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:07.458+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:41.000577+0000 front 2026-02-13T02:47:41.000639+0000 (oldest deadline 2026-02-13T02:48:03.900595+0000) 2026-02-13T02:48:08.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:07 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:07.973+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:08.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:07 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:07.973+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:08.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:07 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:07.973+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:08.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:07 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:07.973+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:08.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:07 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:07.973+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:08.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:08 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:08.103+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:08.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:08 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:08.103+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:08.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:08 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:08.103+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:08.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:08 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:08.103+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:08.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:08 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:08.103+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:08.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:08 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:08.474+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:08.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:08 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:08.474+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:08.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:08 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:08.474+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:08.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:08 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:08.474+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:08.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:08 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:08.474+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:41.000577+0000 front 2026-02-13T02:47:41.000639+0000 (oldest deadline 2026-02-13T02:48:03.900595+0000) 2026-02-13T02:48:09.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:08 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:08.940+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:09.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:08 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:08.940+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:09.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:08 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:08.940+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:09.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:08 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:08.940+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:09.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:08 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:08.940+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:09.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:09 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:09.137+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:09.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:09 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:09.137+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:09.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:09 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:09.137+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:09.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:09 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:09.137+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:09.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:09 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:09.137+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:09.976 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:09 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:09.480+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:09.977 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:09 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:09.480+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:09.977 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:09 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:09.480+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:09.977 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:09 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:09.480+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:09.977 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:09 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:09.480+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:41.000577+0000 front 2026-02-13T02:47:41.000639+0000 (oldest deadline 2026-02-13T02:48:03.900595+0000) 2026-02-13T02:48:10.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:09.941+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:10.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:09.941+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:10.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:09.941+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:10.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:09.941+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:10.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:09.941+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:10.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:09 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:09.941+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:10.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:10 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:10.128+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:10.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:10 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:10.128+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:10.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:10 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:10.128+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:10.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:10 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:10.128+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:10.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:10 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:10.128+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:10.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:10 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:10.457+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:18.099635+0000 front 2026-02-13T02:47:18.099430+0000 (oldest deadline 2026-02-13T02:47:42.199371+0000) 2026-02-13T02:48:10.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:10 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:10.457+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:22.199675+0000 front 2026-02-13T02:47:22.199979+0000 (oldest deadline 2026-02-13T02:47:46.899620+0000) 2026-02-13T02:48:10.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:10 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:10.457+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.899892+0000 front 2026-02-13T02:47:26.899810+0000 (oldest deadline 2026-02-13T02:47:52.199855+0000) 2026-02-13T02:48:10.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:10 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:10.457+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:32.200070+0000 front 2026-02-13T02:47:32.200160+0000 (oldest deadline 2026-02-13T02:48:01.000368+0000) 2026-02-13T02:48:10.727 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:10 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9[53183]: 2026-02-13T02:48:10.457+0000 7f99991026c0 -1 osd.9 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:41.000577+0000 front 2026-02-13T02:47:41.000639+0000 (oldest deadline 2026-02-13T02:48:03.900595+0000) 2026-02-13T02:48:11.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:10 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:10.945+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:11.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:10 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:10.945+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:11.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:10 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:10.945+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:11.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:10 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:10.945+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:11.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:10 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:10.945+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:11.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:10 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:10.945+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:11.347 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73867]: 2026-02-13 02:48:11.049925622 +0000 UTC m=+5.130148553 container died 345bf8b8ace15a2eb7ae0e20aaa7fafa5cb256fe909717237c847dcb8d81067f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, name=rockylinux, summary=Rocky Linux Base image, version=10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:48:11.348 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73867]: 2026-02-13 02:48:11.109023633 +0000 UTC m=+5.189246554 container remove 345bf8b8ace15a2eb7ae0e20aaa7fafa5cb256fe909717237c847dcb8d81067f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, version=10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default) 2026-02-13T02:48:11.348 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 bash[73867]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9 2026-02-13T02:48:11.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.106+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:11.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.106+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:11.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.106+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:11.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.106+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:11.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.106+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:11.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.106+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.784983+0000 front 2026-02-13T02:47:46.785005+0000 (oldest deadline 2026-02-13T02:48:10.884966+0000) 2026-02-13T02:48:11.616 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73967]: 2026-02-13 02:48:11.346888382 +0000 UTC m=+0.026390898 container create 02443c5d8f7163f02b2559e506bc445767bfaa890f8fdbb887a0410a4f19fa1b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.version=10, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:48:11.616 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73967]: 2026-02-13 02:48:11.402488582 +0000 UTC m=+0.081991108 container init 02443c5d8f7163f02b2559e506bc445767bfaa890f8fdbb887a0410a4f19fa1b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9-deactivate, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, io.buildah.version=1.33.7, ceph=True) 2026-02-13T02:48:11.616 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73967]: 2026-02-13 02:48:11.408414098 +0000 UTC m=+0.087916624 container start 02443c5d8f7163f02b2559e506bc445767bfaa890f8fdbb887a0410a4f19fa1b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, ceph=True, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, version=10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:48:11.616 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73967]: 2026-02-13 02:48:11.409368104 +0000 UTC m=+0.088870630 container attach 02443c5d8f7163f02b2559e506bc445767bfaa890f8fdbb887a0410a4f19fa1b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, license=BSD-3-Clause, io.buildah.version=1.33.7, ceph=True, version=10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:48:11.617 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73967]: 2026-02-13 02:48:11.338020717 +0000 UTC m=+0.017523253 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:48:11.617 INFO:journalctl@ceph.osd.9.trial078.stdout:Feb 13 02:48:11 trial078 podman[73967]: 2026-02-13 02:48:11.584072506 +0000 UTC m=+0.263575032 container died 02443c5d8f7163f02b2559e506bc445767bfaa890f8fdbb887a0410a4f19fa1b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-9-deactivate, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:48:11.672 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.9.service' 2026-02-13T02:48:11.741 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:11.741 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T02:48:11.741 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T02:48:11.741 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.10 2026-02-13T02:48:12.083 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 systemd[1]: Stopping Ceph osd.10 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.840+0000 7f5e7a2466c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.840+0000 7f5e7a2466c0 -1 osd.10 79 *** Got signal Terminated *** 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:11 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:11.840+0000 7f5e7a2466c0 -1 osd.10 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:12 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:12.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:12 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:12.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:12 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:12.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:12 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:12.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:12 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:12.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:12.084 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:12 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:12.082+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.784983+0000 front 2026-02-13T02:47:46.785005+0000 (oldest deadline 2026-02-13T02:48:10.884966+0000) 2026-02-13T02:48:12.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:11 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:11.955+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:12.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:11 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:11.955+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:12.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:11 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:11.955+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:12.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:11 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:11.955+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:12.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:11 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:11.955+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:12.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:11 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:11.955+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:13.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:12 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:12.953+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:13.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:12 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:12.953+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:13.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:12 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:12.953+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:13.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:12 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:12.953+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:13.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:12 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:12.953+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:13.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:12 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:12.953+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:13.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:13 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:13.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:13.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:13 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:13.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:13.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:13 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:13.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:13.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:13 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:13.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:13.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:13 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:13.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:13.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:13 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:13.078+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.784983+0000 front 2026-02-13T02:47:46.785005+0000 (oldest deadline 2026-02-13T02:48:10.884966+0000) 2026-02-13T02:48:14.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:13.977+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:14.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:13.977+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:14.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:13.977+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:14.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:13.977+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:14.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:13.977+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:14.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:13 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:13.977+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:14.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:14 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:14.056+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:14.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:14 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:14.056+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:14.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:14 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:14.056+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:14.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:14 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:14.056+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:14.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:14 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:14.056+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:14.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:14 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:14.056+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.784983+0000 front 2026-02-13T02:47:46.785005+0000 (oldest deadline 2026-02-13T02:48:10.884966+0000) 2026-02-13T02:48:15.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:14 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:14.946+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:15.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:14 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:14.946+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:15.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:14 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:14.946+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:15.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:14 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:14.946+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:15.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:14 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:14.946+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:15.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:14 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:14.946+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:15.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:14 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:14.946+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:15.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:15 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:15.017+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:15.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:15 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:15.017+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:15.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:15 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:15.017+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:15.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:15 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:15.017+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:15.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:15 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:15.017+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:15.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:15 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:15.017+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.784983+0000 front 2026-02-13T02:47:46.785005+0000 (oldest deadline 2026-02-13T02:48:10.884966+0000) 2026-02-13T02:48:15.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:15 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:15.017+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:50.885261+0000 front 2026-02-13T02:47:50.885247+0000 (oldest deadline 2026-02-13T02:48:14.385164+0000) 2026-02-13T02:48:16.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:15 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:15.954+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:16.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:15 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:15.954+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:16.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:15 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:15.954+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:16.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:15 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:15.954+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:16.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:15 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:15.954+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:16.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:15 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:15.954+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:16.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:15 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:15.954+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:16.445 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:16.025+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.083180+0000 front 2026-02-13T02:47:17.083223+0000 (oldest deadline 2026-02-13T02:47:40.583022+0000) 2026-02-13T02:48:16.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:16.025+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:20.583152+0000 front 2026-02-13T02:47:20.583137+0000 (oldest deadline 2026-02-13T02:47:45.883244+0000) 2026-02-13T02:48:16.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:16.025+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:29.883867+0000 front 2026-02-13T02:47:29.883893+0000 (oldest deadline 2026-02-13T02:47:52.783911+0000) 2026-02-13T02:48:16.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:16.025+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:33.884291+0000 front 2026-02-13T02:47:33.884382+0000 (oldest deadline 2026-02-13T02:47:57.384282+0000) 2026-02-13T02:48:16.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:16.025+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:37.384448+0000 front 2026-02-13T02:47:37.384438+0000 (oldest deadline 2026-02-13T02:48:03.284540+0000) 2026-02-13T02:48:16.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:16.025+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.784983+0000 front 2026-02-13T02:47:46.785005+0000 (oldest deadline 2026-02-13T02:48:10.884966+0000) 2026-02-13T02:48:16.446 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10[52268]: 2026-02-13T02:48:16.025+0000 7f5e7690b6c0 -1 osd.10 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:50.885261+0000 front 2026-02-13T02:47:50.885247+0000 (oldest deadline 2026-02-13T02:48:14.385164+0000) 2026-02-13T02:48:17.190 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 podman[60445]: 2026-02-13 02:48:16.899894255 +0000 UTC m=+5.071983068 container died 84655ef13e188e25d90e44f25cbde2a7212a986eaafaac7cd3ddb69e338e600b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10, ceph=True, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 podman[60445]: 2026-02-13 02:48:16.908460056 +0000 UTC m=+5.080548879 container remove 84655ef13e188e25d90e44f25cbde2a7212a986eaafaac7cd3ddb69e338e600b (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause) 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:16 trial091 bash[60445]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:17 trial091 podman[60576]: 2026-02-13 02:48:17.035851761 +0000 UTC m=+0.014805785 container create 4df23d735d9687379e3dee17be001c4db0b3e77c9e0bb4394786c2e09f96e3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.version=10) 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:17 trial091 podman[60576]: 2026-02-13 02:48:17.062600744 +0000 UTC m=+0.041554708 container init 4df23d735d9687379e3dee17be001c4db0b3e77c9e0bb4394786c2e09f96e3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:17 trial091 podman[60576]: 2026-02-13 02:48:17.065187777 +0000 UTC m=+0.044141731 container start 4df23d735d9687379e3dee17be001c4db0b3e77c9e0bb4394786c2e09f96e3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, io.buildah.version=1.33.7, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:17 trial091 podman[60576]: 2026-02-13 02:48:17.065743598 +0000 UTC m=+0.044697562 container attach 4df23d735d9687379e3dee17be001c4db0b3e77c9e0bb4394786c2e09f96e3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.version=10, summary=Rocky Linux Base image, name=rockylinux, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:17 trial091 podman[60576]: 2026-02-13 02:48:17.02972597 +0000 UTC m=+0.008679944 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:48:17.191 INFO:journalctl@ceph.osd.10.trial091.stdout:Feb 13 02:48:17 trial091 podman[60576]: 2026-02-13 02:48:17.190268982 +0000 UTC m=+0.169222946 container died 4df23d735d9687379e3dee17be001c4db0b3e77c9e0bb4394786c2e09f96e3e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-10-deactivate, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:48:17.222 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.10.service' 2026-02-13T02:48:17.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:17.258 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T02:48:17.259 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T02:48:17.259 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.11 2026-02-13T02:48:17.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:16 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:16.949+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:17.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:16 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:16.950+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:17.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:16 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:16.950+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:17.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:16 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:16.950+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:17.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:16 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:16.950+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:17.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:16 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:16.950+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:17.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:16 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:16.950+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:17.766 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 systemd[1]: Stopping Ceph osd.11 for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:17.766 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.350+0000 7f1345b816c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:48:17.766 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.350+0000 7f1345b816c0 -1 osd.11 79 *** Got signal Terminated *** 2026-02-13T02:48:17.766 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.350+0000 7f1345b816c0 -1 osd.11 79 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:48:18.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.976+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:18.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.976+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:18.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.976+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:18.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.976+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:18.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.976+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:18.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.976+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:18.267 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:17 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:17.976+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:19.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:18 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:18.995+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:19.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:18 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:18.995+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:19.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:18 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:18.995+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:19.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:18 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:18.995+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:19.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:18 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:18.995+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:19.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:18 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:18.995+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:19.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:18 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:18.995+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:20.265 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:20 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:20.007+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:20.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:20 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:20.007+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:20.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:20 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:20.007+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:20.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:20 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:20.007+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:20.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:20 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:20.007+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:20.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:20 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:20.007+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:20.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:20 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:20.007+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:21.516 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.015+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:21.516 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.015+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:21.516 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.015+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:21.516 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.015+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:21.516 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.015+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:21.516 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.015+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:21.516 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.015+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:22.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.971+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6806 osd.0 since back 2026-02-13T02:47:17.018402+0000 front 2026-02-13T02:47:17.018268+0000 (oldest deadline 2026-02-13T02:47:41.718291+0000) 2026-02-13T02:48:22.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.971+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6804 osd.1 since back 2026-02-13T02:47:24.018737+0000 front 2026-02-13T02:47:24.018733+0000 (oldest deadline 2026-02-13T02:47:46.918742+0000) 2026-02-13T02:48:22.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.971+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T02:47:26.918878+0000 front 2026-02-13T02:47:26.918891+0000 (oldest deadline 2026-02-13T02:47:51.618975+0000) 2026-02-13T02:48:22.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.971+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6814 osd.3 since back 2026-02-13T02:47:35.119417+0000 front 2026-02-13T02:47:35.119405+0000 (oldest deadline 2026-02-13T02:47:58.619436+0000) 2026-02-13T02:48:22.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.971+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.91:6812 osd.4 since back 2026-02-13T02:47:42.119875+0000 front 2026-02-13T02:47:42.119867+0000 (oldest deadline 2026-02-13T02:48:06.819807+0000) 2026-02-13T02:48:22.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.971+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T02:47:46.819942+0000 front 2026-02-13T02:47:46.819947+0000 (oldest deadline 2026-02-13T02:48:09.720029+0000) 2026-02-13T02:48:22.266 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:21 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11[53370]: 2026-02-13T02:48:21.971+0000 7f133e23e6c0 -1 osd.11 79 heartbeat_check: no reply from 10.20.193.78:6822 osd.6 since back 2026-02-13T02:47:49.720274+0000 front 2026-02-13T02:47:49.720259+0000 (oldest deadline 2026-02-13T02:48:14.420217+0000) 2026-02-13T02:48:22.701 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63025]: 2026-02-13 02:48:22.409586498 +0000 UTC m=+5.071228915 container died f1df994d7d5eae6040618b2cb2d72f02ab5c16bbb1a3ca04edbd7b393f6f2ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:48:22.701 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63025]: 2026-02-13 02:48:22.418382869 +0000 UTC m=+5.080025286 container remove f1df994d7d5eae6040618b2cb2d72f02ab5c16bbb1a3ca04edbd7b393f6f2ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, name=rockylinux, org.opencontainers.image.version=10, io.buildah.version=1.33.7, version=10, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:48:22.702 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 bash[63025]: ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11 2026-02-13T02:48:22.702 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63159]: 2026-02-13 02:48:22.545723246 +0000 UTC m=+0.016334578 container create 0657d7a6abc378797303ff36d71a71e3debc35788b9349faa66800c7d9209162 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux) 2026-02-13T02:48:22.702 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63159]: 2026-02-13 02:48:22.577586864 +0000 UTC m=+0.048198206 container init 0657d7a6abc378797303ff36d71a71e3debc35788b9349faa66800c7d9209162 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:48:22.702 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63159]: 2026-02-13 02:48:22.580223328 +0000 UTC m=+0.050834670 container start 0657d7a6abc378797303ff36d71a71e3debc35788b9349faa66800c7d9209162 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11-deactivate, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:48:22.702 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63159]: 2026-02-13 02:48:22.580732841 +0000 UTC m=+0.051344183 container attach 0657d7a6abc378797303ff36d71a71e3debc35788b9349faa66800c7d9209162 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, version=10, OSD_FLAVOR=default, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:48:22.702 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63159]: 2026-02-13 02:48:22.53931799 +0000 UTC m=+0.009929332 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:48:22.702 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 02:48:22 trial154 podman[63159]: 2026-02-13 02:48:22.698178252 +0000 UTC m=+0.168789584 container died 0657d7a6abc378797303ff36d71a71e3debc35788b9349faa66800c7d9209162 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-osd-11-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:48:22.733 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@osd.11.service' 2026-02-13T02:48:22.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:22.808 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T02:48:22.808 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T02:48:22.808 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.a 2026-02-13T02:48:23.227 INFO:journalctl@ceph.mds.a.trial078.stdout:Feb 13 02:48:22 trial078 systemd[1]: Stopping Ceph mds.a for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:23.227 INFO:journalctl@ceph.mds.a.trial078.stdout:Feb 13 02:48:22 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-a[58351]: 2026-02-13T02:48:22.985+0000 7f6c952e36c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:23.227 INFO:journalctl@ceph.mds.a.trial078.stdout:Feb 13 02:48:22 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-a[58351]: 2026-02-13T02:48:22.985+0000 7f6c952e36c0 -1 mds.a *** got signal Terminated *** 2026-02-13T02:48:25.873 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.a.service' 2026-02-13T02:48:25.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:25.938 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T02:48:25.938 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T02:48:25.938 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.d 2026-02-13T02:48:26.477 INFO:journalctl@ceph.mds.d.trial078.stdout:Feb 13 02:48:26 trial078 systemd[1]: Stopping Ceph mds.d for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:26.477 INFO:journalctl@ceph.mds.d.trial078.stdout:Feb 13 02:48:26 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-d[57523]: 2026-02-13T02:48:26.156+0000 7fa80dc526c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:26.477 INFO:journalctl@ceph.mds.d.trial078.stdout:Feb 13 02:48:26 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-d[57523]: 2026-02-13T02:48:26.156+0000 7fa80dc526c0 -1 mds.d *** got signal Terminated *** 2026-02-13T02:48:27.280 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.d.service' 2026-02-13T02:48:27.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:27.345 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T02:48:27.345 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T02:48:27.345 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.g 2026-02-13T02:48:27.727 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:48:27 trial078 systemd[1]: Stopping Ceph mds.g for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:27.727 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:48:27 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-g[57987]: 2026-02-13T02:48:27.517+0000 7f80c6e0b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:27.727 INFO:journalctl@ceph.mds.g.trial078.stdout:Feb 13 02:48:27 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-g[57987]: 2026-02-13T02:48:27.517+0000 7f80c6e0b6c0 -1 mds.g *** got signal Terminated *** 2026-02-13T02:48:28.634 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.g.service' 2026-02-13T02:48:28.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:28.699 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T02:48:28.699 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T02:48:28.699 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.j 2026-02-13T02:48:29.227 INFO:journalctl@ceph.mds.j.trial078.stdout:Feb 13 02:48:28 trial078 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-j[57230]: 2026-02-13T02:48:28.913+0000 7f337ac106c0 -1 mds.j *** got signal Terminated *** 2026-02-13T02:48:30.156 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.j.service' 2026-02-13T02:48:30.223 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:30.223 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T02:48:30.223 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T02:48:30.223 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.b 2026-02-13T02:48:30.695 INFO:journalctl@ceph.mds.b.trial091.stdout:Feb 13 02:48:30 trial091 systemd[1]: Stopping Ceph mds.b for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:30.696 INFO:journalctl@ceph.mds.b.trial091.stdout:Feb 13 02:48:30 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-b[56883]: 2026-02-13T02:48:30.320+0000 7f484d1096c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:30.696 INFO:journalctl@ceph.mds.b.trial091.stdout:Feb 13 02:48:30 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-b[56883]: 2026-02-13T02:48:30.320+0000 7f484d1096c0 -1 mds.b *** got signal Terminated *** 2026-02-13T02:48:37.299 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.b.service' 2026-02-13T02:48:37.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:37.333 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T02:48:37.333 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T02:48:37.334 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.e 2026-02-13T02:48:37.695 INFO:journalctl@ceph.mds.e.trial091.stdout:Feb 13 02:48:37 trial091 systemd[1]: Stopping Ceph mds.e for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:37.696 INFO:journalctl@ceph.mds.e.trial091.stdout:Feb 13 02:48:37 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-e[56236]: 2026-02-13T02:48:37.469+0000 7fd50e6626c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:37.696 INFO:journalctl@ceph.mds.e.trial091.stdout:Feb 13 02:48:37 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-e[56236]: 2026-02-13T02:48:37.469+0000 7fd50e6626c0 -1 mds.e *** got signal Terminated *** 2026-02-13T02:48:38.752 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.e.service' 2026-02-13T02:48:38.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:38.786 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T02:48:38.786 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T02:48:38.786 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.h 2026-02-13T02:48:38.926 INFO:journalctl@ceph.mds.h.trial091.stdout:Feb 13 02:48:38 trial091 systemd[1]: Stopping Ceph mds.h for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:39.195 INFO:journalctl@ceph.mds.h.trial091.stdout:Feb 13 02:48:38 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-h[56560]: 2026-02-13T02:48:38.924+0000 7f6146dce6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:39.196 INFO:journalctl@ceph.mds.h.trial091.stdout:Feb 13 02:48:38 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-h[56560]: 2026-02-13T02:48:38.924+0000 7f6146dce6c0 -1 mds.h *** got signal Terminated *** 2026-02-13T02:48:40.849 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.h.service' 2026-02-13T02:48:40.881 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:40.882 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T02:48:40.882 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T02:48:40.882 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.k 2026-02-13T02:48:41.195 INFO:journalctl@ceph.mds.k.trial091.stdout:Feb 13 02:48:40 trial091 systemd[1]: Stopping Ceph mds.k for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:41.196 INFO:journalctl@ceph.mds.k.trial091.stdout:Feb 13 02:48:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-k[55914]: 2026-02-13T02:48:41.016+0000 7fc4db8a06c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:41.196 INFO:journalctl@ceph.mds.k.trial091.stdout:Feb 13 02:48:41 trial091 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-k[55914]: 2026-02-13T02:48:41.016+0000 7fc4db8a06c0 -1 mds.k *** got signal Terminated *** 2026-02-13T02:48:42.079 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.k.service' 2026-02-13T02:48:42.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:42.113 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T02:48:42.114 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T02:48:42.114 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.c 2026-02-13T02:48:42.516 INFO:journalctl@ceph.mds.c.trial154.stdout:Feb 13 02:48:42 trial154 systemd[1]: Stopping Ceph mds.c for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:42.516 INFO:journalctl@ceph.mds.c.trial154.stdout:Feb 13 02:48:42 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-c[57961]: 2026-02-13T02:48:42.207+0000 7faf3a7336c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:42.516 INFO:journalctl@ceph.mds.c.trial154.stdout:Feb 13 02:48:42 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-c[57961]: 2026-02-13T02:48:42.207+0000 7faf3a7336c0 -1 mds.c *** got signal Terminated *** 2026-02-13T02:48:44.931 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.c.service' 2026-02-13T02:48:44.966 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:44.966 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T02:48:44.966 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T02:48:44.967 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.f 2026-02-13T02:48:45.219 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 02:48:45 trial154 systemd[1]: Stopping Ceph mds.f for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:45.219 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 02:48:45 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-f[57636]: 2026-02-13T02:48:45.090+0000 7f7e58e0d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:45.219 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 02:48:45 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-f[57636]: 2026-02-13T02:48:45.090+0000 7f7e58e0d6c0 -1 mds.f *** got signal Terminated *** 2026-02-13T02:48:46.189 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.f.service' 2026-02-13T02:48:46.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:46.225 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T02:48:46.225 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T02:48:46.225 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.i 2026-02-13T02:48:46.516 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 02:48:46 trial154 systemd[1]: Stopping Ceph mds.i for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:46.516 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 02:48:46 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-i[58286]: 2026-02-13T02:48:46.347+0000 7f49609506c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:46.516 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 02:48:46 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-i[58286]: 2026-02-13T02:48:46.347+0000 7f49609506c0 -1 mds.i *** got signal Terminated *** 2026-02-13T02:48:47.753 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.i.service' 2026-02-13T02:48:47.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:47.787 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T02:48:47.787 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T02:48:47.787 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.l 2026-02-13T02:48:48.016 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:48:47 trial154 systemd[1]: Stopping Ceph mds.l for 1779b03c-0885-11f1-aeb9-d404e6e7d460... 2026-02-13T02:48:48.016 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:48:47 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-l[57313]: 2026-02-13T02:48:47.914+0000 7f4fb18a16c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:48:48.016 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 02:48:47 trial154 ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460-mds-l[57313]: 2026-02-13T02:48:47.914+0000 7f4fb18a16c0 -1 mds.l *** got signal Terminated *** 2026-02-13T02:48:48.993 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1779b03c-0885-11f1-aeb9-d404e6e7d460@mds.l.service' 2026-02-13T02:48:49.026 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:48:49.027 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T02:48:49.027 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 --force --keep-logs 2026-02-13T02:48:49.213 INFO:teuthology.orchestra.run.trial078.stdout:Deleting cluster with fsid: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:48:52.381 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 --force --keep-logs 2026-02-13T02:48:52.501 INFO:teuthology.orchestra.run.trial091.stdout:Deleting cluster with fsid: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:48:54.335 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 --force --keep-logs 2026-02-13T02:48:54.456 INFO:teuthology.orchestra.run.trial154.stdout:Deleting cluster with fsid: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:48:56.263 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:48:56.322 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:48:56.351 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:48:56.380 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T02:48:56.384 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial078/crash 2026-02-13T02:48:56.385 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash -- . 2026-02-13T02:48:56.440 INFO:teuthology.orchestra.run.trial078.stderr:tar: /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T02:48:56.441 INFO:teuthology.orchestra.run.trial078.stderr:tar: Error is not recoverable: exiting now 2026-02-13T02:48:56.444 DEBUG:teuthology.misc:Transferring archived files from trial091:/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial091/crash 2026-02-13T02:48:56.445 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash -- . 2026-02-13T02:48:56.472 INFO:teuthology.orchestra.run.trial091.stderr:tar: /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T02:48:56.473 INFO:teuthology.orchestra.run.trial091.stderr:tar: Error is not recoverable: exiting now 2026-02-13T02:48:56.475 DEBUG:teuthology.misc:Transferring archived files from trial154:/var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial154/crash 2026-02-13T02:48:56.476 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash -- . 2026-02-13T02:48:56.504 INFO:teuthology.orchestra.run.trial154.stderr:tar: /var/lib/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T02:48:56.504 INFO:teuthology.orchestra.run.trial154.stderr:tar: Error is not recoverable: exiting now 2026-02-13T02:48:56.505 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T02:48:56.505 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T02:48:56.569 INFO:teuthology.orchestra.run.trial078.stdout:2026-02-13T02:39:58.483220+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:48:56.570 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T02:48:56.571 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -E '\[SEC\]' /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T02:48:56.632 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -E '\[ERR\]' /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T02:48:56.697 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -E '\[WRN\]' /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T02:48:56.762 INFO:teuthology.orchestra.run.trial078.stdout:2026-02-13T02:39:58.483220+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:48:56.763 INFO:tasks.cephadm:Compressing logs... 2026-02-13T02:48:56.764 DEBUG:teuthology.orchestra.run.trial078:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:48:56.767 DEBUG:teuthology.orchestra.run.trial091:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:48:56.770 DEBUG:teuthology.orchestra.run.trial154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:48:56.792 INFO:teuthology.orchestra.run.trial091.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T02:48:56.793 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T02:48:56.793 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.y.log 2026-02-13T02:48:56.793 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.b.log 2026-02-13T02:48:56.794 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.h.log 2026-02-13T02:48:56.794 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.7.log 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.h.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.10.log 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.4.log 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log: 34.8% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.b.log 2026-02-13T02:48:56.797 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log 2026-02-13T02:48:56.798 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.1.log 2026-02-13T02:48:56.798 INFO:teuthology.orchestra.run.trial091.stderr: 92.2% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T02:48:56.798 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log 2026-02-13T02:48:56.798 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.k.log 2026-02-13T02:48:56.798 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.e.log 2026-02-13T02:48:56.798 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log.gz 2026-02-13T02:48:56.798 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.e.log: 86.4% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log.gz 2026-02-13T02:48:56.802 INFO:teuthology.orchestra.run.trial154.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T02:48:56.802 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T02:48:56.802 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.2.log 2026-02-13T02:48:56.802 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.i.log 2026-02-13T02:48:56.802 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.c.log 2026-02-13T02:48:56.802 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.f.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.5.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.11.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.5.log: /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log: 34.8% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.z.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.l.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.c.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log 2026-02-13T02:48:56.803 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.8.log 2026-02-13T02:48:56.804 INFO:teuthology.orchestra.run.trial154.stderr: 91.1% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log.gz 2026-02-13T02:48:56.804 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log: /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.8.log: 86.5% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log.gz 2026-02-13T02:48:56.804 INFO:teuthology.orchestra.run.trial154.stderr: 92.4% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T02:48:56.804 INFO:teuthology.orchestra.run.trial154.stderr: 94.0% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log.gz 2026-02-13T02:48:56.805 INFO:teuthology.orchestra.run.trial091.stderr: 93.3% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log.gz 2026-02-13T02:48:56.805 INFO:teuthology.orchestra.run.trial091.stderr: 94.1% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T02:48:56.806 INFO:teuthology.orchestra.run.trial154.stderr: 94.2% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T02:48:56.807 INFO:teuthology.orchestra.run.trial091.stderr: 94.8% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T02:48:56.808 INFO:teuthology.orchestra.run.trial154.stderr: 94.3% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T02:48:56.809 INFO:teuthology.orchestra.run.trial091.stderr: 95.0% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T02:48:56.809 INFO:teuthology.orchestra.run.trial154.stderr: 95.1% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T02:48:56.810 INFO:teuthology.orchestra.run.trial154.stderr: 94.6% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T02:48:56.818 INFO:teuthology.orchestra.run.trial078.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T02:48:56.818 INFO:teuthology.orchestra.run.trial078.stderr:: No such file or directory 2026-02-13T02:48:56.818 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.a.log 2026-02-13T02:48:56.819 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.d.log 2026-02-13T02:48:56.820 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.j.log 2026-02-13T02:48:56.820 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.a.log: /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.0.log 2026-02-13T02:48:56.821 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.3.log 2026-02-13T02:48:56.822 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log 2026-02-13T02:48:56.822 INFO:teuthology.orchestra.run.trial078.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T02:48:56.822 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.0.log: /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.a.log 2026-02-13T02:48:56.822 INFO:teuthology.orchestra.run.trial078.stderr: 94.9% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T02:48:56.823 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.g.log 2026-02-13T02:48:56.823 INFO:teuthology.orchestra.run.trial078.stderr: 60.8% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T02:48:56.824 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log 2026-02-13T02:48:56.825 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.g.log: /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log 2026-02-13T02:48:56.826 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.6.log 2026-02-13T02:48:56.828 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.audit.log.gz 2026-02-13T02:48:56.829 INFO:teuthology.orchestra.run.trial078.stderr: 94.8% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T02:48:56.829 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.x.log 2026-02-13T02:48:56.829 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log 2026-02-13T02:48:56.829 INFO:teuthology.orchestra.run.trial091.stderr: 93.3% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T02:48:56.831 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log: /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.9.log 2026-02-13T02:48:56.831 INFO:teuthology.orchestra.run.trial078.stderr: 93.1% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-volume.log.gz 2026-02-13T02:48:56.833 INFO:teuthology.orchestra.run.trial078.stderr: 86.5% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph.log.gz 2026-02-13T02:48:56.834 INFO:teuthology.orchestra.run.trial078.stderr: 94.7% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T02:48:56.834 INFO:teuthology.orchestra.run.trial078.stderr: 94.0% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T02:48:56.900 INFO:teuthology.orchestra.run.trial091.stderr: 91.7% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T02:48:56.905 INFO:teuthology.orchestra.run.trial154.stderr: 91.8% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T02:48:56.938 INFO:teuthology.orchestra.run.trial154.stderr: 92.6% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T02:48:56.939 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.9.log: 89.9% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T02:48:56.972 INFO:teuthology.orchestra.run.trial154.stderr: 92.3% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T02:48:56.984 INFO:teuthology.orchestra.run.trial091.stderr: 92.1% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T02:48:56.987 INFO:teuthology.orchestra.run.trial091.stderr: 92.4% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T02:48:56.991 INFO:teuthology.orchestra.run.trial154.stderr: 92.2% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T02:48:57.010 INFO:teuthology.orchestra.run.trial154.stderr: 92.2% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T02:48:57.011 INFO:teuthology.orchestra.run.trial091.stderr: 92.2% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T02:48:57.012 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-13T02:48:57.012 INFO:teuthology.orchestra.run.trial154.stderr:real 0m0.225s 2026-02-13T02:48:57.012 INFO:teuthology.orchestra.run.trial154.stderr:user 0m0.840s 2026-02-13T02:48:57.012 INFO:teuthology.orchestra.run.trial154.stderr:sys 0m0.070s 2026-02-13T02:48:57.013 INFO:teuthology.orchestra.run.trial078.stderr: 92.4% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T02:48:57.015 INFO:teuthology.orchestra.run.trial078.stderr: 92.3% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T02:48:57.019 INFO:teuthology.orchestra.run.trial078.stderr: 92.1% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T02:48:57.020 INFO:teuthology.orchestra.run.trial078.stderr: 92.0% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T02:48:57.039 INFO:teuthology.orchestra.run.trial091.stderr: 92.4% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T02:48:57.040 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-13T02:48:57.040 INFO:teuthology.orchestra.run.trial091.stderr:real 0m0.256s 2026-02-13T02:48:57.040 INFO:teuthology.orchestra.run.trial091.stderr:user 0m0.987s 2026-02-13T02:48:57.040 INFO:teuthology.orchestra.run.trial091.stderr:sys 0m0.064s 2026-02-13T02:48:57.145 INFO:teuthology.orchestra.run.trial078.stderr: 90.2% -- replaced with /var/log/ceph/1779b03c-0885-11f1-aeb9-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T02:48:57.148 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T02:48:57.149 INFO:teuthology.orchestra.run.trial078.stderr:real 0m0.349s 2026-02-13T02:48:57.149 INFO:teuthology.orchestra.run.trial078.stderr:user 0m1.082s 2026-02-13T02:48:57.149 INFO:teuthology.orchestra.run.trial078.stderr:sys 0m0.210s 2026-02-13T02:48:57.150 INFO:tasks.cephadm:Archiving logs... 2026-02-13T02:48:57.150 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial078/log 2026-02-13T02:48:57.152 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:48:57.380 DEBUG:teuthology.misc:Transferring archived files from trial091:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial091/log 2026-02-13T02:48:57.381 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:48:57.502 DEBUG:teuthology.misc:Transferring archived files from trial154:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial154/log 2026-02-13T02:48:57.503 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:48:57.614 INFO:tasks.cephadm:Removing cluster... 2026-02-13T02:48:57.614 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 --force 2026-02-13T02:48:57.801 INFO:teuthology.orchestra.run.trial078.stdout:Deleting cluster with fsid: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:48:58.068 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 --force 2026-02-13T02:48:58.189 INFO:teuthology.orchestra.run.trial091.stdout:Deleting cluster with fsid: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:48:58.349 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1779b03c-0885-11f1-aeb9-d404e6e7d460 --force 2026-02-13T02:48:58.468 INFO:teuthology.orchestra.run.trial154.stdout:Deleting cluster with fsid: 1779b03c-0885-11f1-aeb9-d404e6e7d460 2026-02-13T02:48:58.626 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T02:48:58.626 DEBUG:teuthology.orchestra.run.trial078:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T02:48:58.667 DEBUG:teuthology.orchestra.run.trial091:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T02:48:58.685 DEBUG:teuthology.orchestra.run.trial154:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T02:48:58.704 INFO:tasks.cephadm:Teardown complete 2026-02-13T02:48:58.704 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T02:48:58.706 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T02:48:58.720 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T02:48:58.735 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T02:48:58.735 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:48:58.739 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:48:58.742 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:48:59.004 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T02:48:59.015 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T02:48:59.016 DEBUG:teuthology.orchestra.run.trial078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:48:59.018 DEBUG:teuthology.orchestra.run.trial091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:48:59.020 DEBUG:teuthology.orchestra.run.trial154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:48:59.034 INFO:teuthology.orchestra.run.trial091.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:48:59.036 INFO:teuthology.orchestra.run.trial154.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:48:59.052 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:48:59.057 INFO:teuthology.orchestra.run.trial091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:48:59.058 INFO:teuthology.orchestra.run.trial091.stdout:=============================================================================== 2026-02-13T02:48:59.058 INFO:teuthology.orchestra.run.trial091.stdout:^+ 157.245.125.229 2 6 377 46 -62us[ -119us] +/- 38ms 2026-02-13T02:48:59.058 INFO:teuthology.orchestra.run.trial091.stdout:^* as393746.mci.trtnw.net 2 6 377 46 -508us[ -565us] +/- 24ms 2026-02-13T02:48:59.058 INFO:teuthology.orchestra.run.trial091.stdout:^- 170-187-142-180.ip.linod> 2 6 377 45 -12ms[ -12ms] +/- 82ms 2026-02-13T02:48:59.058 INFO:teuthology.orchestra.run.trial091.stdout:^+ ntp.sfo.icanbwell.com 2 6 377 46 -276us[ -333us] +/- 38ms 2026-02-13T02:48:59.063 INFO:teuthology.orchestra.run.trial154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:48:59.063 INFO:teuthology.orchestra.run.trial154.stdout:=============================================================================== 2026-02-13T02:48:59.063 INFO:teuthology.orchestra.run.trial154.stdout:^+ 38.45.64.130 2 6 377 47 -1556us[-1201us] +/- 19ms 2026-02-13T02:48:59.063 INFO:teuthology.orchestra.run.trial154.stdout:^* ntp4.glypnod.com 2 6 377 47 -1615us[-1261us] +/- 14ms 2026-02-13T02:48:59.064 INFO:teuthology.orchestra.run.trial154.stdout:^+ 136-55-44-51.googlefiber> 2 6 377 47 +5412us[+5767us] +/- 20ms 2026-02-13T02:48:59.064 INFO:teuthology.orchestra.run.trial154.stdout:^- kc1cloud.147.72.155.23.m> 3 6 377 48 -3904us[-3550us] +/- 51ms 2026-02-13T02:48:59.076 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:48:59.076 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-13T02:48:59.076 INFO:teuthology.orchestra.run.trial078.stdout:^- ntp.maxhost.io 2 6 377 46 -6025us[-6050us] +/- 66ms 2026-02-13T02:48:59.076 INFO:teuthology.orchestra.run.trial078.stdout:^- arm1.maxhost.io 2 6 377 47 -514us[ -539us] +/- 55ms 2026-02-13T02:48:59.076 INFO:teuthology.orchestra.run.trial078.stdout:^* 107-172-222-7-host.coloc> 2 6 377 46 +98us[ +73us] +/- 13ms 2026-02-13T02:48:59.077 INFO:teuthology.orchestra.run.trial078.stdout:^+ sensei.ruselabs.com 2 6 377 44 +178us[ +178us] +/- 37ms 2026-02-13T02:48:59.077 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T02:48:59.088 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T02:48:59.088 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T02:48:59.103 DEBUG:teuthology.orchestra.run.trial078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T02:48:59.218 DEBUG:teuthology.orchestra.run.trial091:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T02:48:59.264 DEBUG:teuthology.orchestra.run.trial154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T02:48:59.312 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T02:48:59.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:48:59.371 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T02:48:59.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:48:59.398 DEBUG:teuthology.orchestra.run.trial154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T02:48:59.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:48:59.425 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T02:48:59.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T02:48:59.457 INFO:teuthology.task.internal:Duration was 789.650535 seconds 2026-02-13T02:48:59.457 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T02:48:59.482 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T02:48:59.483 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:48:59.486 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:48:59.489 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:48:59.524 INFO:teuthology.orchestra.run.trial091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:48:59.526 INFO:teuthology.orchestra.run.trial154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:48:59.566 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:49:00.021 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T02:49:00.022 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial078.front.sepia.ceph.com 2026-02-13T02:49:00.022 DEBUG:teuthology.orchestra.run.trial078:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:49:00.068 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial091.front.sepia.ceph.com 2026-02-13T02:49:00.069 DEBUG:teuthology.orchestra.run.trial091:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:49:00.089 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial154.front.sepia.ceph.com 2026-02-13T02:49:00.090 DEBUG:teuthology.orchestra.run.trial154:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:49:00.111 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T02:49:00.111 DEBUG:teuthology.orchestra.run.trial078:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:49:00.115 DEBUG:teuthology.orchestra.run.trial091:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:49:00.131 DEBUG:teuthology.orchestra.run.trial154:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:49:00.404 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T02:49:00.404 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:49:00.408 DEBUG:teuthology.orchestra.run.trial091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:49:00.410 DEBUG:teuthology.orchestra.run.trial154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:49:00.432 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:49:00.433 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:49:00.433 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:49:00.434 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:49:00.434 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:49:00.435 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:49:00.436 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:49:00.436 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:49:00.436 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:49:00.436 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:49:00.446 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:49:00.451 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:49:00.459 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:49:00.460 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:49:00.461 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:49:00.461 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:49:00.461 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:49:00.511 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:49:00.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T02:49:00.532 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T02:49:00.533 DEBUG:teuthology.orchestra.run.trial078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:49:00.590 DEBUG:teuthology.orchestra.run.trial091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:49:00.615 DEBUG:teuthology.orchestra.run.trial154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:49:00.640 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T02:49:00.656 DEBUG:teuthology.orchestra.run.trial078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:49:00.660 DEBUG:teuthology.orchestra.run.trial091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:49:00.662 DEBUG:teuthology.orchestra.run.trial154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:49:00.684 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern = core 2026-02-13T02:49:00.704 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern = core 2026-02-13T02:49:00.729 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = core 2026-02-13T02:49:00.757 DEBUG:teuthology.orchestra.run.trial078:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:49:00.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:49:00.793 DEBUG:teuthology.orchestra.run.trial091:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:49:00.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:49:00.810 DEBUG:teuthology.orchestra.run.trial154:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:49:00.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:49:00.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T02:49:00.844 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T02:49:00.845 DEBUG:teuthology.misc:Transferring archived files from trial078:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial078 2026-02-13T02:49:00.845 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:49:00.922 DEBUG:teuthology.misc:Transferring archived files from trial091:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial091 2026-02-13T02:49:00.923 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:49:00.957 DEBUG:teuthology.misc:Transferring archived files from trial154:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48009/remote/trial154 2026-02-13T02:49:00.958 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:49:00.994 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T02:49:00.995 DEBUG:teuthology.orchestra.run.trial078:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:49:00.999 DEBUG:teuthology.orchestra.run.trial091:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:49:01.001 DEBUG:teuthology.orchestra.run.trial154:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:49:01.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T02:49:01.065 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T02:49:01.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T02:49:01.081 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T02:49:01.082 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:49:01.086 DEBUG:teuthology.orchestra.run.trial091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:49:01.088 DEBUG:teuthology.orchestra.run.trial154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:49:01.104 INFO:teuthology.orchestra.run.trial091.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:49 /home/ubuntu/cephtest 2026-02-13T02:49:01.105 INFO:teuthology.orchestra.run.trial154.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:49 /home/ubuntu/cephtest 2026-02-13T02:49:01.121 INFO:teuthology.orchestra.run.trial078.stdout: 917533 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:49 /home/ubuntu/cephtest 2026-02-13T02:49:01.123 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T02:49:01.141 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T02:49:01.182 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated-and-quota} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} duration: 789.6505346298218 failure_reason: '"2026-02-13T02:39:58.483220+0000 mon.a (mon.0) 406 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T02:49:01.182 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T02:49:01.308 INFO:teuthology.run:FAIL